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This  report  describes  an  investigation  conducted  by  the  Hughes 
Aircraft  Company,  Radar  Systems  Group,  El  Segundo,  California,  to  test 
the  use  of  the  geometric  moments  of  an  image  and  of  the  rotationally  invari¬ 
ant  functions  of  these  moments  for  the  automatic  recognition  of  aircraft 
targets  from  radar  images.  The  effort  consisted  of  radar  image  generation 
from  real  data  and  analysis  and  computer  studies  of  statistical  pattern  recog¬ 
nition  techniques  for  the  automatic  recognition  of  targets  using  the  geometric 
moments  of  radar  images. 

The  investigation  was  performed  by  the  Signal  Exploitation  Programs 
Office  of  Hughes'  Radar  Systems  Group,  for  the  Office  of  Naval  Research, 
Arlington,  Virginia,  under  Contract  N000 14 -  79  - C- 0643 . 

Dr.  George  A.  Ioannidis  served  as  the  Hughes  program  manager. 
Commander  Stacy  Holmes  followed  by  Commander  Roger  Nichols  were  the 
program  managers  for  the  Office  of  Naval  Research,  Arlington,  Virginia. 

The  analytical  tasks  for  this  study  were  carried  out  by  the  program 
manager  with  help  from  Jon  P.  Belleville,  who  also  contributed  to  the  devel¬ 
opment  of  the  software  and  wrote  Appendix  A. 

The  major  contributor  to  the  development  of  the  software  for  this 
study  was  Charles  P.  Dolan  who  also  wrote  Appendix  B. 

This  final  report  is  submitted  in  accordance  with  the  data  require¬ 
ments  of  Exhibit  A,  dated  20  August  1979,  Sequence  A002  of  the  contract 
Data  Requirements  List  1423. 

The  author  acknowledges  the  support  and  contributions  of 
Messrs.  James  Crosby,  Manager,  and  Calvin  Boerman,  Assistant  Manager 
of  Signal  Exploitation  Programs  at  Hughes.  The  author  also  thanks 
Dr.  Chung-Ching  Chen  who  provided  the  images  of  the  F -  1  1  1 . 
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SECTION  I 

INTRODUCTION  AND  SUMMARY 


In  the  past,  most  radar  target  recognition  techniques  have 
concentrated  on  the  use  of  one  -  dimens  ionai  target  signatures.  However,  the 
development  of  the  Synthetic  Aperture  Radar  (SAR)  and  the  recent  develop¬ 
ment  of  the  Inverse  Synthetic  Aperture  (ISAR)  technologies  have  made  it  pos¬ 
sible  to  obtain  radar  images  of  targets  and  thus  allow  the  use  of  two- 
dimensional  pattern  classification  schemes  for  automatic  radar  target  recog¬ 
nition.  One  such  two-dimensional  shape  recognition  scheme  is  a  technique 
known  as  the  method  of  moments,  which  has  been  successfully  applied  to  the 
recognition  of  objects  imaged  in  the  visible  and  infrared  spectrum.  Recently 
under  an  Office  of  Naval  Research  (ONR)  sponsored  i nve stigation  Gonzalez 
and  Moret  [h)  applied  the  method  of  moments  to  the  classification  of  simu¬ 
lated  radar  images.  Their  results  showed  that  very  good  classification  per¬ 
formance  could  be  obtained  using  this  technique. 

In  this  investigation  sponsored  by  ONR  the  Hughes  Aircraft  Company 
studied  the  application  of  the  geometric  moments  of  an  image  and  rotationally 
invariant  functions  of  these  moments  to  the  automatic  recognition  of  aircraft 
targets  from  their  radar  images.  The  images  used  in  this  investigation  were 
generated  by  the  application  of  the  ISAR  technique  to  turntable  radar  data  and 
also  data  obtained  from  flying  aircraft  targets.  /The  turntable  data  had  been 
obtained  at  the  RATSCAT  facility  under  the  AFAL  E-3A  Non-Cooperative 
Data  Collection  program  and  consist  of  X-band  measurements  against 
!  ,  3  scale  models  of  an  F- 1 02 ,  an  F-5E,  an  A  -10.  an  F-15  and  a  Y  F-  1  o. 

The  data  were  collected  using  the  stepped  frequency  technique  using  a  total 
of  2  M.>  3.4  MHz  frequency  steps  to  synthesize  an  870.4  MHz  bandwidth.  For 
the  full  scale  targets  these  measurements  correspond  to  b'-band  data  at 
!-■  MHz  bandwidth.  The  targets  were  placed  on  a  rotary  platform  which 
rotated  it  0.2  degree  increments  between  adjacent  bursts  oi  the  25o  frequency 
.-tens.  In  addition  to  the  RATSCAT  data,  measurements  for  a  maneuvering 
F  -  1  1  aircraft  and  a  DC-1"  during  take  off  were  also  used.  The  data  on  file 

F-ll  i  were  obtained  using  the  ALGOR  radar  which  uses  a  linear  F-M  pulse 
i;h  m.1i)  MHz  bandwidth.  The  data  on  the  DC-  10  were  obtained  lay  in  S-b.und 


radar  operated  by  the  Naval  Ocean  Systems  Center  tNOSC)  in  San  Diego.  By 
stepping  the  transmitter  frequency  pulse  to  pulse  at  1.08  MHz  increments  over 
a  total  of  25o  pulses  this  radar  has  an  effective  bandwidth  of  276  MHz.  The 
images  of  the  F-lll  were  available  from  the  work  of  Chen  and  Andrews  [Uj. 
Images  for  all  these  aircraft  targets  were  generated  using  the  techniques 
described  in  Section  2. 

Using  the  above  data  a  set  of  540  images  was  formed  from  the 
RATSCAT  data  base  fl08  images  per  target  for  an  F-102,  an  F-15,  an 
YF-lo,  an  F-5E,  and  an  A-  10).  The  first  72  images  for  each  target  were 
obtained  using  the  lower  128  frequencies  covering  a  bandwidth  of  128  MHz 
out  of  a  total  of  25o  MHz  measurement  bandwidth.  The  last  5o  images  out 
of  the  total  of  108  images  per  target  were  obtained  using  the  upper  128  fre¬ 
quencies.  The  resulting  range  resolution  was  1.  17  meters.  The  images 
were  formed  for  a  3-degree  rotation  of  the  target  which  results  in  a  cross 
range  resolution  of  0.  95  meters.  The  images  were  formed  over  the  following 
set  of  as  pec  t  angles  0-3  degrees,  5-8  degrees,  .  .  .  ,  175-178  degrees  and 

2-5  degrees,  7-10  degrees,  12-15  degrees . 177-  180  degrees  for  the 

first  set  of  128  frequencies  and  for  aspects  0-3  degrees,  5-8  degrees,  .  .  .  , 
175-  178  degrees  for  the  second  set  of  128  frequencies . 

The  images  of  the  F-lll  obtained  using  the  ALCOR  radar  ranged 
over  the  following  aspect  angles:  0-3  degrees,  5-8  degrees,  .  .  .  , 

85-87  degrees  and  2-5  degrees,  7-10  degrees,  .  .  .  ,  87-'-‘0  degrees.  All  of 
the  above  images  corresponded  to  top  views  of  the  targets,  i.e.  .  projections 
on  tne  horizontal  plane.  F rom  the  XOSC  data  set  a  small  number  of  images, 

10  top  views,  and  10  side  views  were  obtained  for  a  DC- 10.  However, 
because  the  target  in  this  case  was  moving  it  was  necessary  to  use  the  full 
25o  MHz  measurement  bandwidth  to  properly  focus  and  align  the  range  signa¬ 
tures  used  in  forming  the  image.  For  classification  tests  only  the  ten  side 
%  lew  s  oin. lined  on  this  target  were  used.  These  images  were  combined  with 
a  set  Hi  ten  side  view  images  obtained  using  RATSCAT  measurements  for  the 
1  -  w.  and  A- 10.  In  addition  to  the  above  classification  tests  the  classifiers 
"ere  ilso  presented  with  top  view  images  of  the  KAfSCAT  targets  obtained 
using  the  lull  2  5(,  MHz  bandwidth  and  i  n.  2  degree  rotation  ot  the  target. 

1- i  r  these  tests  24  images  per  target  for  the  five  K  A  T.5CA  T  targets  were 


formed  over  the  following  set  of  aspects:  0.8-7  degrees,  3.8-10  degrees, 
6.8-13  degrees,  ...,  33. 8-40  degrees  and  140. 8-147  degrees,  143.8- 
150  degrees,  ...,  173. 8-180  degrees.  The  images  used  in  this  study  are 
given  in  Table  1. 

In  addition  to  the  generation  of  the  above  images,  software  was 
developed  for  image  processing  such  as  background  noise  computation,  adap¬ 
tive  threshold  adjustment,  edge  enhancement  and  edge  detection.  Software 
was  also  developed  for  the  computation  of  all  central  moments  of  orders  two 
to  seven  and  of  all  orthogonal  moment  invariant  functions  using  moments  of 
orders  two  to  seven.  As  described  m  Section  III,  the  total  number  of  required 
moments  is  33  and  is  also  equal  to  the  total  number  of  invariants.  Also  three 
general  algebraic  invariants  were  computed  as  described  in  Section  111. 


TABLE  1.  RADAR  IMAGES  OF  AIRCRAFT  TARGETS 
GENERATED  FOR  THIS  STUDY 
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Moments  and  invariants  were  computed  from  both  the  image  and  the  edge 
detected  image  (contour  image)  and  classification  tests  were  performed  using 
feature  vectors  constructed  from  the  moments  and  feature  vectors  constructed 
from  the  invariants.  In  addition  to  feature  vectors  computed  from  the  geometric 
moments  and  invariants  features  obtained  by  collapsing  the  image  intensities 
along  two  orthogonal  axes  (parallel  and  normal  to  the  fuselage  orientation)  as 
described  in  Section  IV  were  tested. 

As  seen  in  the  results  from  the  class  ification  tests  presented  m 
Sections  VI  and  VII  the  best  performance  (84  to  by  percent  correct)  was 
observed  for  feature  vectors  using  the  central  moments  of  the  image  ant1 
al  so  for  combinations  of  moments  from  the  image  and  the  edge  detected 
image.  The  results  are  encouraging  and  suggest  that  the  geometric  moments 
may  prove  to  be  important  features  for  the  application  of  statistical  pattern 
recognition  techniques  to  the  identification  of  aircraft  targets  from  radar 
images.  However,  because  a  limited  set  of  imaging  geometries  (only  plan 
views  corresponding  to  projections  on  the  horizontal  plane  for  zero  roll  and 
profiles  corresponding  to  projections  on  the  vertical  plane)  was  used  in  this 
study  'tlie  performance  of  the  techniques  as  a  function  of  roll  and  pitch  angles 
was  not  investigated.  Further  more  it  was  assumed  that  the  imaging  plane 
was  known.  The  determination  of  the  target  view  presented  by  the  image  is 
an  important  problem  that  will  be  addressed  in  follow-on  work  in  this  area. 

In  addition  to  the  above  classification  results  obtained  during  this 
study  a  technique  was  also  developed  which  uses  invariant  moment  tunctions 
for  the  computation  of  the  cross  range  scale  in  1SAR  images  ot  targets  whose 
rotation  rate  is  not  known  a  priori. 

Section  II  contains  a  discussion  of  the  1SAR  imaging  and  image  processing 
ale  ’fithms  used  m  tins  stuhv.  Section  III  is  a  discussion  of  the  geometr ;  c 
moments  and  invariant  functions  of  these  moments  and  their  use  m  the  commit. i- 
r;on  >1  the  target  asoect  and  the  comnutation  ot  the  v.ross  range  scale  factor  ot 
lS.\i\  images.  A  recognition  scheme  based  on  image  >  11, losing  ulotig  two 

•rtii  g  vial  axes  u  discussed  in  Section  IV  and  Section  V  contains  a  drscriot:  >n 
>t  the  »  lassif  ;e  r  s  used  n  this  investigation  as  well  as  two  lei  Uniques  used  tor 
reducing  the  d.mens;  .-laFt'.  t  the  feature  vectors.  1'lie  cl  i  s  s  i  f ;  c  a  t .  o  n  results 
are  contained  n  Soi  t:->n  V I  and  the  .  >nvlusn>ns  are  given  in  Se.  tout  V 11.  1  'etuil.- 
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on  the  computation  of  the  invariant  functions  and  a  brief  discussion  of  the 
software  used  in  this  study  are  found  m  Appendices  A  and  B,  respectively. 


Se  ct  1<J  n  II 

INVERSE  SAR  IMAGING  BY  FREQUENCY  STEPPING 


The  most  common  radar  imaging  technique  today  is  the  SAR  method 
used  primarily  for  ground  mapping  by  airborne  radars.  The  method 
employs  high  range  resolution  waveforms  and  takes  advantage  of  the  linear 
translational  motion  of  the  airborne  antenna  to  generate  a  synthetic  long 
array  with  an  effective  azimuth  beamwidth  several  times  smaller  than  the 
beamwidth  of  the  radar  antenna.  Thus  radar  images  of  the  ground  and  of 
ground  targets  are  generated. 

When  the  radar  target  is  moving  (thus  causing  a  change  in  target 
aspect)  a  simiLar  technique  called  ISAR  can  be  used  to  image  targets  in 
motion.  The  method  takes  advantage  of  the  relative  doppler  shift  of  the  sig¬ 
nals  returned  from  the  various  scatters  on  the  target  (as  a  result  of  the  tar¬ 
get’s  rotational  motion)  to  obtain  the  scatterers  cross  range  locations.  Either 
a  single  wideband  pulse  waveform  or  a  burst  of  N  narrow  band  pulses  stepped 
in  frequency  pulse  to  pulse  over  a  large  bandwidth  can  be  used  to  obtain  the 
range  profile  of  the  target.  For  the  stepped  frequency  waveform,  a  synthetic 
high  resolution  range  profile  is  obtained  by  Fourier  transforming  the  target 
echoes  per  frequency  burst.  The  time  history  of  the  range  profiles  for  a  tar¬ 
get  with  a  changing  aspect  contains  doppler  frequencies  that  are  directly 
related  to  the  target  scatterers  cross  range  locations.  Thus  the  cross  range 
dimension  at  each  range  cell  of  a  rotating  target  is  obtained  by  Fourier  trans¬ 
forming  the  echo  history  of  the  range  ceil.  In  this  way,  range  and  cross 
range  data  are  mapped  into  a  target  image. 


1  r  AXGE-DOPPLER  IMAGING  OF  TARGETS  CN  A  ROTARi  PLATl-ORM 
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Radar  imaging  of  targets  on  a  rotary  platform  with  a  stepped 
rniency  radar  system  is  briefly  described  here.  The  processing  alg 
hms  for  the  formation  t  -adar  image  ot  the  target  are  derived  by 
Ring  the  target  bv  a  collection  of  many  point  scatterers  as  dosor:ue< 


<  )  - 

r  t‘  nr  i*  - 
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Chen  and  Andrews  (1),  Walker  (2)  and  Wehner  (3).  Even  though  the  analysis 
presented  here  follows  this  point  scatterer  model,  the  resulting  imaging 
algorithms  are  also  valid  for  targets  that  consist  of  one  large  continuous- 
surface  with  dimensions  much  larger  than  the  radar  wavelength,  as  it  follows 
from  the  work  of  R.M.  Lewis  (4)  who  by  the  use  of  physical  optics  formulas, 
found  the  same  imaging  algorithms  as  those  obtained  by  the  point  scatterer 
model. 

For  the  geometry  of  Figure  1,  assume  that  the  target  consists  of 
a  large  number  of  point  scatterers.  After  coherent  demodulation  the  received 
radar  echo  as  a  function  of  transmitter  frequency  f  (wave  number  k  =  ZM’/c) 
and  target  aspect  angle  G  is  given  by 

EA  j2k  •  R  j'  __  —  _ 

U  ( f ,  0  )  =  - - - e  °  /  P(  r;0)  e-^  '  ‘  rds(r)  (1) 

2\w  kR“  -1 

o  Sj 

where  p(r;  6)  is  the  complex  target  reflectivity  at  point  r  on  the  target  sur¬ 
face  when  the  aspect  angle  is  6,  k  is  a  vector  pointing  from  the  radar 
towards  the  center  of  the  target  and  its  magnitude  is  equal  to  the  radar  wave 
number  given  by 


2_r  3irf 
\  “  c 


(2) 


E  is  the  amplitude  of  the  transmitted  pulse,  A^  is  the  effective  antenna 

aperture  of  the  radar,  R  is  the  target  ranee,  and  the  surface  integral  is 

o  _ 

over  the  illuminated  target  surface  Sj.  Expressing  the  vectors  k  and  r  of 
Equat1  in  (1)  in  terms  of  the  body  coordinates  X,  V  (see  Fuzure  1) 

=  xp  yp 

X  V 


2k  •  r 
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where: 


p  =  t4rf/c)  cos  0,  p  -  1 4  tt  f  /  c )  sin  0 

~x  y 

x  =  r  cos  a  and  y  =  r  sin  o 
Substituting  from  Equation  (3)  into  (1), 
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which  shows  that  the  measured  signal  is  a  sample  of  the  two  dimensional 
Fourier  transform  of  the  target's  reflectivity  projected  onto  the  horizontal 
plane  and  modulated  by  the  linear  phase  term 
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When  in  the  measurement  setup  of  Figure  1  pul  se  -  to- pul  se  frequency 


stepping  is  used  over  a  bandwidth  if  -  f  .  ),  the  resulting  measurements 

max  min 


correspond  to  samples  of  U  ( Px»  P  .)  over  a  region  D  in  (p^_,  p^  )  space  which 
is  a  section  of  a  ring  between  two  circles  with  radii  p^  and  p,  as  shown  in 
Figure  3.  The  cor  resounding  measurement  transfer  function  is 


II  (p.  p  1 
rx  ~  v 


p  cos  e 


Pv  =  p  sin  6 


(3a) 


Pj  <  p<  p,  ,  -  ’=^r  -  9  Pv  *  =  0  >  otherwise.  (3b) 

When  A9  is  small  and  Ip,  -  pj)  •  •  1/3  (p,  *  pj  ),  the  Fourier  transform  of 
this  measurement  transfer  function  is  given  by 

s in  '  p\  AB/ 3  )  #  sin  I  x  Ap/3  \ 
i  pv  AB/3  )  ,  xAp/3  ) 


Figure  2.  Mapping  of  measurement  region  in  wave  number  space, 
for  measurement  set  up  of  Figure  1 


For  numerical  computations, 

p  =  Pj  +  kAp  ,  P2  =  pj  +  (N-l)  Ap 

e  =  ise  -  ,  ag  =  ( M- 1 ) 6 e 
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In  most  radar  image  applications,  only  the  first  summation  is  used.  The 
second  summation  which  is  multiplied  by  the  very  small  factor 


2  urn  / Ap 

—  (if 


where  m  is  the  cross  range  dimension  index  (y  =  m  Ay)  is  a  small  correc¬ 
tion  term  that  accounts  for  the  error  introduced  by  the  approximations  used 
in  the  polar  to  rectangular  conversion  and  is  usually  neglected.  The  above 
polar-to-rectangular  conversion  also  imposes  a  restriction  on  the  maximum 
size  of  the  angular  sector  A0  in  the  measurement  space  that  can  be 
processed  coherently  to  form  a  radar  image.  For  large  values  of  A0,  the 
polar-to-rectangular  conversion  introduces  an  error  caused  by  scatterer 
motion  through  resolution  cells.  This  problem  imposes  the  following 
resolution  limitations  [5]  when  Equation  (12)  is  used 


ACR  > 


ACR  '  AR  > 


whe  re : 


ACR  =  cross  ranee  resolution 


AR  =  ranee  resolution 


L  ■  tareet  length  in  ranee 


D  •-  tareet  width  in  cross  ranee,  and 


\  =  radar  wavelength. 

This  limitation  can  be  avoided  by  polar  format  processing  using  Equa¬ 
tion  flu)  at  the  expense  of  a  computationally  inefficient  algorithm. 

Ihc  stepped  frequency  technique  was  used  to  form  images  of  fi 
aircraft  models.  The  data  used  for  these  images  were  collected  it 
3  A  F.-'CA  f  it  \-oanb  against  1  :■  scale  models  . . :  an  F-  1  02,  an  F  -vl. 


.  in  r - i -  an 


an  A- 10.  A  total  ot  2.0  j.  4  M !  !z  f  renuencv  s  tens 


l  '• 


were  used.  The  targets  were  placed  on  a  rotary  platform  that  rotated  at 
0.2  degree  increments.  To  avoid  range  aliasing  the  frequency  step  size 
must  be  less  than  (c/4L)  where  L  is  the  target  length.  To  avoid  cross 
range  aliasing  the  angular  increment  must  be  less  than  (A./4D),  where  X.  is 
the  radar  wavelength  and  D  is  the  cross  range  target  dimension.  In  the  RAT- 
SCAT  measurements  the  frequency  step  was  adequate  to  avoid  range  aliasing, 
but  the  0.2  degree  angular  increment  was  somewhat  high  for  aspect  angles 
near  the  broadside  of  the  target.  By  introducing  a  human  observer  in  many 
of  the  cases  where  cross  range  aliasing  occurred  for  aspect  angles  other 
than  head-on-broadside,  the  images  were  corrected  when  the  aliased  part 
could  be  resolved  in  the  range  dimension.  The  five  scaled  aircraft  models 
were  mounted  both  horizontally  and  vertically  on  the  rotary  platform  so  that 
both  yaw  and  pitch  angle  rotation  could  be  simulated.  The  measurements 
obtained  when  the  targets  were  horizontally  mounted  on  the  platform  gave 
plan  (top)  view  images  of  the  targets;  examples  are  shown  in  Figures  3 
through  8.  The  vertical  mounting  resulted  in  profile  (side)  view  images  as 
shown  in  Figures  9  and  10.  For  most  of  the  classification  tests  described 
below,  the  top  view  images  of  the  targets  were  used.  One  test,  however, 
was  performed  with  profiles  of  the  F-rE,  the  A- 10  and  of  a  DC- 10  during 
take  oil;  stepped  frequency  measurements  provided  by  the  Naval  Ocean 
Systems  Center  (NOSC)  in  San  Diego  wore  used.  The  technique  used  to 
image  that  target  is  described  below. 

2.  2  RANGE- DOPPLER  IMAGING  OF  MOVING  TARGETS 

When  the  target  is  moving,  in  addition  to  the  change  in  target  aspect, 
the  range  between  the  radar  and  the  target  is  also  changing.  As  a  result  of 
sucli  range  changes  during  formation  of  the  radar  image  the  images  appear 
to  be  out  iit  torus.  The  signal  processing  technique  used  to  correct  for  this 
defocusing  etiect  is  known  as  autofocusing  if  it  relies  only  on  the  received 
radar  signal  to  accomplish  this  task.  Although  the  autofocusing  problem  for 
the  stepped  frequency  waveforms,  in  principle,  is  similar  to  the  uu  tc  ifn«-  ■.  s  ing 
orciilem  for  the  single  wideband  oulse  waveform,  in  the  st  -noed  frequence 
case  a  correction  must  also  be  introduced  to  account  tor  phase  error- 
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caused  by  the  changing  target  range  during  transmission  of  a  single  N 
frequency  pulse  burst. 

As  shown  in  Figure  11  when  the  imaging  radar  employs  pulse-to- 
pulse  frequency  stepping  to  synthesize  a  high  range  resolution  target 
profile,  the  received  target  echo  at  each  frequency  can  be  considered  as  a 
frequency  sample  of  the  Fourier  transform  F(f,  ,  6.)  of  the  target's  range 

K  1 

response  multiplied  by  quadratic  and  linear  phase  error  terms  introduced 

by  the  target  range  R  and  target  radial  velocity  R.  As  seen  in  Figure  11, 

o 

the  received  signal  as  a  function  of  frequencv  f,  and  aspect  angle  6.  is  given 
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where  Rq  is  the  target  range  at  aspect  8^  when  frequency  f  is  transmitted, 

\  ,  is  the  mean  radar  wavelength,  Af  is  the  frequency  step  size,  AT  is 
the  pulse  repetition  interval  (  PRI)  between  transmissions  at  adjacent  fre¬ 
quencies,  and  T  =  N  •  AT  is  the  burst  time.  The  effect  of  the  linear  phase 
errors  introduced  by  the  first  three  complex  exponentials  in  Equation  (15) 
is  a  translation  of  the  resulting  radar  image  in  the  image  plane  and  does  not 
affect  the  image  quality.  Rut  the  last  two  complex  exponential  terms  in 
Equation  (15)  are  quadratic  functions  of  the  muices  i  and  k  and  have  a 
defocusing  and  blurring  effect  on  the  resulting  radar  image.  Autofocusing 
algorithms  attempt  to  correct  the  effect  of  these  two  quadratic  phase  error 
terms.  The  autofocusing  algorithms  user:  ,n  Figure  id  to  correct  lor  the 
re;  i  dm  tic  phase  error  involving  the  product  « i  *  k  •  is  known  a  s  range  ,hgn- 
ment  while  trie  correction  for  the  quadratic  error  involving  jn  Equa¬ 
te. n  (151  . .  n  ■.  n  as  quadratic  oiiase  c  m.oensation  and  is  needed  netore 
• : . e  returns  .A  a  single  hurst  can  be  Fourier  ra. informed  to  o'otain  tlie  '•  ig'n 
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Figure  1 1 .  ISAR  imaging  of  target  by  radar  using  pulse  to  pulse  frequency  stepping. 
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F'gure  12.  Signal  processing  functions  needed  in  formation  of  ISAR  images  using  stepped  frequency  technique. 


range  resolution  profile.  A  signal  processing  block  for  correction  of  phase 
errors  introduced  by  Fresnel  region  terms  is  also  shown  in  Figure  1Z. 

This  correction  accounts  for  a  quadratic  phase  error  introduced  by  the 
assumption  that  the  radar  signals  are  plane  waves  rather  than  spherical 
waves  and  is  only  important  at  relatively  short  ranges. 

When  autofocusing  is  used  for  range  alignment,  it  is  usually  assumed 
that  the  target's  rotational  motion  is  relatively  slow  in  comparison  to  the 
N-pulse  burst  time,  so  that  two  adjacent  range  signatures  are  approximately 
equal.  With  this  assumption,  the  problem  of  range  alignment  can  be 
expressed  as  an  optimization  problem,  where  an  unknown  linear  phase  func¬ 
tion  of  the  form  exp  [ -j  (2rrf  d.  +$.)]  is  sought  so  that  the  function 

\T- 1  2 
e-  -  j(  2-rrf  d.  +6  .)  j 

J  =  >.  U(£k’  ei}  '  U(fk’  ®i-l)  6  1  1  !  (lb) 


is  minimized. 

Then  the  resulting  value  of  d^  is  an  estimate  of  the  (range  displace¬ 
ment)  time  delay  between  the  two  range  profiles  at  aspect  angles  0.  and  0._  , 
and  <b.  is  a  phase  difference  between  the  two  profiles.  In  general  depending 
on  the  spectral  characteristics  of  the  signal,  filters  Hj(f)  and  H0(f)  are  intro¬ 
duced  and  the  resulting  criterion  function  becomes 


H,  (f,  )  U  <f.  ,  6.) 

Ik  k  i 


-  H,  (fk)  U  (fR.  0.+1)  exp  ( -jZ-r^d.  -  j  d> . )  j ' 
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where: 


W(fk)  =  H } ( f k )  H2'(£k)  ,  (19) 

is  a  frequency  weighting  that  depends  on  the  spectral  characteristics  of  the 
signal  and  interference.  For  example  when  W(fk)  =  1.0  then  using  Parseval's 
theorem,  it  can  be  easily  shown  that  the  maximum  value  of  Q  is  equal  to  the 
square  of  the  maximum  cross  correlation  peak  between  the  two  range  profiles. 

Once  estimates  for  the  delays  d.'s  and  phase  angles  qUs  are  obtained, 
then  assuming  that  the  range  rate  R  is  approximately  constant  during  a  burst 
period  a  quadratic  phase  compensation  can  be  introduced  to  account  for  range 
changes  during  one  range  signature  time. 

The  above  processing  technique  was  used  to  generate  inverse  SAR 
images  of  a  DC- 10  during  take  off.  The  data  were  obtained  by  an  S-band 
radar  operated  bv  NOSC  in  San  Diego,  CA.  By  stepping  the  transmitted 
frequency  pulse  to  pulse  at  1  MHz  increments  over  a  total  bandwidth  of 
256  MHz,  this  radar  obtains  a  synthetic  high  range  resolution  profile  every 
0.05  second.  A  total  of  64  range  profiles  are  used  to  form  an  image. 
Depending  on  the  apparent  target  rotation  (yaw  or  pitch)  plan  (top)  or  pro¬ 
file  (side)  view  images  of  the  target  are  obtained.  Figure  13  is  an  example 
of  the  plan  (top)  and  of  the  side  view  images  for  the  above  DC- 10  generated 
using  the  processing  described  in  Figure  12.  Ten  side  view  images  of  this 
target,  10  side  view  images  of  an  F-5E  and  10  images  of  an  A- 10, 
were  used  for  classification  tests  using  the  method  of  moments.  The 
results  are  presented  in  Section  VI. 

2.  3  IMAGE  PREPROCESSING  FOR  AUTOMATIC  TARGET  RECOGNITION 

Before  the  radar  images  generated  by  the  coherent  processing  of  the 
radar  returns  as  described  in  Figure  12  are  presented  to  the  classifier, 
an  adaptive  thresholding  scheme  is  used  to  remove  noise  in  the  images. 
Furthermore,  the  edge  detection  scheme  ul  r  -cure  14  is  useti  m  generate 
image  .boundaries.  As  seen  in  that  figure  tile  background  aoi-e  Level  m  the 
image  is  computed,  and  -a  threshold  corresponding  to  4.4  dB  above  liie 
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Figure  19  Target  aircraft  (Sheet  1  of  4) 


b.  Northrop  F-5E  (length  =  14.73  meters,  wing  span  *  8.128  meters) 


General  dynamics  F-16A  (length  *  14.17  meters,  wing  span*  10  meters) 
Figure  19.  Target  aircraft  iSheet  2  of  4) 


Section  III 

RADAR  IMAGE  CLASSIFICATION  USING 
THE  METHOD  OF  MOMENTS 


One  of  the  more  difficult  problems  in  the  design  of  a  recognition 
system  for  pictorial  patterns  is  the  selection  of  a  set  of  appropriate  numeri¬ 
cal  attributes  or  features  to  be  extracted  from  the  object  of  interest  for 
classification.  One  set  of  features  that  has  been  applied  successfully  to  the 
recognition  of  optical  pictures  is  the  set  of  geometric  moments  of  the  image 
and  invariant  functions  of  these  moments  ft>  ] ,  [7],  fi-J  ] ,  .  The  geometric 
moments  and  invariant  moment  functions  and  their  use  in  classifying  radar 
images  of  targets  are  detailed  in  this  section. 


3.  1  CEOMETRIC  MOMENTS  AND  INVARIANT  MOMENT  FUNCTIONS  OF 
IMAGES 

The  non  central  (p  -  q)th  order  moments  of  an  NxM  rectangular  image 

field  fix.,  v.)  are  defined  bv 
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where  'x.,  v .  I  are  the  coordinates  of  the  (i,  j)  cell  and  fix.,  v.)  is  the  intensity 
i  •  j  i  '  j 

function. 

The  central  moments  for  the  same  rectangular  image  field  are 
defined  bv 
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The  normalized  central  moments  are  defined  by 
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and  are  invariant  with  respect  to  changes  in  the  image  intensity.  Central 
moments  as  used  in  this  discussion  are  the  normalized  central  moments 
detined  above. 

From  Equation  (21),  the  central  moments  are  seen  to  be  invariant 
under  translation  but  vary  under  rotations  of  the  image.  Using  the  theory  of 
aleebraic  invariants  Hu[7]  has  shown  that  algebraic  relations  exist  among 
the  central  moments  of  an  imaue  that  are  invariant  under  translation  and 
rotation  see  also  Appendix  A). 

These  invariant  moment  functions  are  of  tile  form 
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and  are  invariant  under  co-ordinate  transformations.  In  particular  a  set  of 
invariants  known  as  orthogonal  invariants  are  functions  whoso  value  does 


rot  change  under  a  rotation  of  co-ordinates,  i.  e.  ,  thev  are  invariant  with 
respect  to  the  orthogonal  transformation 


fo  r  any  ancle  0  , 


p  ( m 
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^nqn 


U-i) 


where  the  nlp.q.  are  computed  using  the  image  intensity  field  fix,  y)  and  the 

m  are  computed  from  fix’,  v).  When  these  functions  are  invariant  under 

Pirn 

rotations  and/or  reflections  about  one  of  the  coordinate  axes  they  are  called 
absolute  orthogonal  invariants.  In  what  follows,  by  'invariants'  we  refer  to 
these  absolute  orthogonal  invariants. 

Using  the  theory  of  algebraic  invariants,  Hu  L  7  ]  has  shown  that  the 
number  of  invariants  involving  moments  from  second  to  nth  order  (n  p  -  q 
are  the  same  as  the  number  of  moments  with  orders  2  to  u  winch  is 


. ,  |n  t  4)  in  -  1 ) 

N  =  - 2 - 

In  optical  and  infrared  image  recognition  systems  only  invariant  functions 
ohmined  from  >he  second  and  third  order  moments  are  usually  used.  For 
these  moments,  there  are  six  absolute  orthogonal  invariants  given  bv 


(28) 
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and  one  skew"  orthogonal  invariant  given  by 

Po  =  T2[(3p2l'p03)(p30'  P12'i  (p30"P12'  ‘3(p2l"  M03  *  ^ 

(31) 

-(K  30- 1Z)(9  ^  ,  ^^03)  !3(M- 30*9  i2)  -  (9-^-9^)“}]. 

Above  Pj ,  P^,  ....  have  been  normalized  by  dividing  by  P^  =  r  to  cancel 
uniform  scale  changes.  Because  the  quality  of  most  radar  images  is  not 
good  compared  to  optical  or  FLIR  images,  the  number  of  moments  and 
invariants  used  in  most  of  the  classification  tests  of  radar  images  described 
in  this  report  is  much  larger  than  six.  In  particular,  all  invariant  functions 
involving  central  moments  up  to  order  n  =  7  (i.  e.  ,  a  total  of  331  were  computed 
using  the  formulas  presented  in  Appendix  A.  In  the  classification  tests,  all 
of  the  above  invariants  as  well  as  smaller  subsets  ot  these  invariants  were 
used  to  construct  feature  vectors.  Classification  results  from  these  tests 
are  ores  onto  a  in  Section  VI. 

Although  tiie  moment  functions  in  Equations  (23)  to  (31)  ao  vc  and 
those  presented  in  \ppendix  A  are  invariant  under  orthogonal  transformations, 
they  are  not  invariant  under  general  algebraic  transformations.  In  oarti.  ular 
it  file  appa  rent  target  rotation  rate  is  not  estimated,  the  «  ross  range  dimen¬ 
sion  of  an  inverse  >AP  image  ma\  not  be  prope  rl\  sealed.  The  re  suit  is  a 
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distorted  image,  which  destroys  the  invariance  of  the  above  moment 
functions,  A  technique  for  estimating  the  cross  range  scale  of  inverse  SAR 
images  using  orthogonal  invariant  moment  functions  is  discussed  in 
Section  3.2.  This  technique  has  been  tested  on  the  turntable  data  but  has  not 
been  proven  yet  on  real  moving  target  data. 

To  overcome  this  scaling  probLem,  Hughes  investigated  the  use  of  a 
set  of  moment  functions  that  are  invariant  under  general  linear  transformations 
provided  that  the  determinant  of  the  transformation  matrix  is  unitv,  i.  e,  , 


a  b 
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where: 


A  =  (ad  -be  1  =  1. 

Such  a  set  exists,  and  for  the  second  and  third  order  moments  Hu  7  gives 
the  following  invariant  moment  functions: 
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These  can  be  normalized  to  generate  a  set  of  general  algebraic 
invariants  given  by 

no  =  1 


n  =  i  / 1  ■ 

1  1  *0 
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n3=I3/Io  (38) 

Using  the  theory  of  algebraic  invariants  a  much  larger  set  of  general 
algebraic  invariants  can  be  derived.  However  in  this  investigation  the  feature 
vectors  that  were  considered  consist  only  of  the  above  three  invariant  func¬ 
tions  as  well  as  the  squares  and  by  two  products  of  these  invariants  as  des¬ 
cribed  in  Section  VI.  In  general,  moments  and  invariants  were  computed  from 
both  the  intensity  modulated  image  and  from  the  edge  detected  image  obtained 
by  the  image  preprocessing  described  in  Section  2.  3. 

3.2  COMPUTATION  OF  TARGET  ASPECT  AND  CROSS  RANGE  SCALING 
USING  THE  GEOMETRIC  MOMENTS 

If  the  rotntionally  invariant  moment  functions  are  used  as  features 
for  classification,  the  target  orientation  in  the  imaging  plane  does  not  have  to 
be  computed.  However,  if  that  orientation  is  desired  so  that  other  recog¬ 
nition  techniques,  which  need  that  information,  can  also  be  applied,  the 
central  moments  can  be  used  to  give  the  target  orientation  as  shown  in  Fig¬ 
ure  2U.  it  is  shown  in  the  figure  that  by  fitting  an  ellipse  to  the  aircraft 
image,  ti-.e  orientation  of  the  major  axis,  which  usually  coincides  with  the 
fuselage.  can  be  otained  from  (see  Hu  (~]1 
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Figure  20..  Computation  of  fuselage  orientation  b>,  fitting  ellipse  to  target  image. 


In  this  study  the  performance  of  the  above  formula  in  estimating  tilt- 
target  aspect  angle  was  tested  using  the  images  of  the  five  RA  I'SCA  I‘  targets 
The  results  are  presented  in  Figure  21  m  the  form  of  a  histogram  that  plots 
frequency  of  occurrence  versus  error  in  orientation  angle  estimate.  A  total 
of  3o  images  per  target  covering  aspect  angles  from  0  degree  (nose  on)  to 
180  degrees  (tail)  were  used  in  constructing  tile  plot  in  Figure  21. 

A  problem  that  often  arises  in  processing  inverse  SA  R  ( ISA  R  \  images 
is  the  determination  of  the  scale  factor  to  be  used  in  converting  relative 
cross  range  doppier  bin  numbers  into  absolute  cross  range  unit-.  For  the 
range  dimension  such  a  scale  factor  is  readilv  available  from  tin-  radar 
range  resolution  cell.  The  «.  omputation  of  the  equivalent  range  cell  alun 

*ne  cross  range  direction,  however,  requires  knowledge  oi  tile  r  nation  rate 
of  tr.e  target  snout  its  centroid  and  i.-  given  jv 
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Figure  21 .  Aspect  angle  error  distribution  over  all  aspects  for  five  RATSCAT  targets. 


who rt-  X  :s  till*  r  tiiar  waveleiujth  in  meter.-,  I  is  the  time  interval  over  which 
Lite  target'-  dopnlcr  iustorv  is  observed  in  tormine  the  ISA R  miaite,  and  9 
l-  tile  rotation  rate  ot  tire  target.  1'lie  r  elure.  to  use  Equation  (40)  lor  the 

computation  ot  the  1  ross  railin'  scale  far  tor  cl.  the  rotation  rate  o  ot  tile 
:i.o\::iit  taro  t  e.iu-t  either  be  known  ot-  estimated  trom  the  radar  d.it.i. 
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If  successive  ISA  R  images  of  a  rotating  radar  target  are  mapped  on 
a  plane  so  that  tiie  x-eooruinate  is  along  the  range  direction  (i.  e.  .  the  radial 
direction  from  the  radar  to  the  target)  and  the  y-coordinate  is  along  the 
cross  range  direction,  as  shown  in  Figure  22,  then  the  above  invariant 
moment  functions  can  be  used  to  compute  the  ratio  of  the  cross  range  to  range 
cell  size. 

Denoting  tins  ratio  by  r,  i.e., 
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DY 

DX 


(41) 


where  DY  is  the  cross  range  cell  size  and  DX  is  the  range  cell  size  the 
orthogonal  invariant  moment  functions  are  shown  to  be  polynomials  m  r. 
For  example,  the  invariant  p  ^  of  Equation  (25)  can  be  expressed  as 


Po  (r)  -  -  r~  *0, 


(42) 


F  qur.'  22.  Two  Aiccessive  ISAR  , mages  rotated  with  respect  lo  each  other  bv  angle  '> 


if  and  (jl  ,  are  computed  by  assuming  that  the  cross  range  cell  size  DY 

is  equal  to  the  range  cell  size  DX.  Similarly  from  Equation  (2t>) 

pl(r)  =fA0Zr  +  2k1  1  r  2  11  ~  ^20  ^02) r  T  ^20  ' 

If  the  above  normalized  central  moments  from  two  successive  inverse 
SAR  images  as  shown  in  Figure  22  are  computed  by  assuming  that  the  range 
and  cross  range  cell  sizes  are  equal  and  if  the  moment  from  the  first  image1 

are  denoted  bv  u  and  those  from  the  second  bv  u'  and  the  corresponding 

pq  -  H  pq 

invariants  are  denoted  bv  p.  and  p'.,  then  for  the  correct  value  of  the  ratio  r 

•  1  i 

p.  (r)  =  p'  .  (r)  (44) 

lor  all  i.  Thus,  Equation  (44)  can  be  used  to  obtain  the  correct  value  of  the 
cross  range  scale  factor.  To  overcome  the  effects  of  noise,  usually  several 
invariant  moment  functions  have  to  be  used  and  an  average  value  of  the 
resulting  values  of  r  is  computed  as  described  below  in  a  numerical  example. 

Application  of  Equation  (44)  to  successive  ISAR  images  as  shown 
in  Figure  22  gives 
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an  oe  jiiiiiiMiii'ii  further  using  the  fact  that 
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i=  an  absolute  algebraic  invariant  (see  Hu  [7]),  i.  e.  ,  it  is  invariant  under 
both  rotations  and  nonuniform  scale  changes  if  the  determinant  ol  the  trans¬ 
formation  is  unity.  Using  this  result.  Equation  (4b)  gives 
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Substitution  from  Equation  (45)  into  the  term 
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As  mentioned  earlier  in  the  absence  of  noise,  Equations  (451  and  (4>s)  must 
have  at  least  one  common  positive  root.  Usually  when  noise  is  present,  tins 
is  not  true  and  the  two  roots  given  by 
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(from  Equation  (451)  and 
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In  combining  these  roots,  only  the  positive  ones  are  considered.  To  give 
equal  weight  to  those  with  r  <  1  as  to  those  with  r  >  1,  the  geometric  rather 
than  the  algebraic  mean  was  used;  i.  e.  , 

7  =  (rl  r2  r3)1/3  (52) 

which  is  equivalent  to  averaging  of  the  logarithm  of  the  above  roots. 

The  above  method  was  used  to  compute  the  ratio  of  the  ranee  to  cross 
range  scale  factor  of  a  set  of  ISAR  images  obtained  from  multifrequency 
step  S-band  data  for  a  scaled  model  of  the  F-5E.  The  data  were  recorded 
at  the  RATSCAT  facility  where  the  target  was  placed  on  a  turntable  and 
slowly  rotated  at  a  known  rate.  Using  Equation  (40)  and  the  known  rotation 
rate,  the  cross  range  cell  size  for  the  images  was  computed.  The  ratio  nt  tin 
cell  size  to  the  radar  range  resolution  cell  for  the  images  was  equal  to  O.Klo. 

Smoothed  estimates  of  the  above  ratio  using  successive  images  of  the 
rotating  target  are  given  in  Table  2.  These  images  were  formed  for  tar¬ 
get  aspects  ranging  from  180  degrees  (tail  aspect)  to  12o  degrees.  The  target 
rotation  between  successive  images  was  3  degrees.  From  the  results  in  this 
table,  the  cross  range  scale  factor  is  estimated  to  within  a  28  percent  accu¬ 
racy.  This  improvement  is  significant  when  compared  to  the  previous  com¬ 
plete  lack  of  any  knowledge  of  the  cross  range  cell  size  dimension.  The 
accuraev  to  within  the  cross  range  scale  factor  is  ost  i  mated  using  this  tech¬ 
nique  will  n  robablv  be  adequate  to  allow  the  use  of  moments  for  the  aut.im.it  tc 
classification  of  aircraft  targets.  However,  no  tests  were  oerforn.ed  m 
’his  -nuiv  to  verifv  this  assumption. 


TABLE  Z.  COMPUTED  RATIO 
OF  CROSS  RANGE  TO  RANGE 
SCALE  FACTOR  USING  PLAN 
VIEWS  OF  THE  F-5E. 


(Correct  Value  is  O.Blo) 


Section  IV 

RANGE  IMAGE  CLASSIFICATION  USING  RANGE 
AND  CROSS  RANGE  COLLAPSING 


In  addition  to  feature  vectors  computed  from  the  geometric  moments 
of  the  image  feature  vectors  obtained  by'  collapsing  the  image  intensities  along 
two  orthogonal  axes  are  also  tested.  Using  the  three  second  order  moments 
Pq3,  and  the  orientation  of  the  target  in  the  image  plane  is  computed 

from  Equation  39  and  the  images  are  rotated  so  that  the  same  orientation 
is  used  for  all  images.  The  intensity  distribution  of  the  rotated  images  is 
then  averaged  along  the  Y  and  X  axes  to  produce  average  X-axis  and  Y-axis 
intensity  profiles  as  shown  in  Figure  23.  The  correlation  functiui  s  of  the 
X-axis  and  the  Y-axis  intensity  profiles  are  computed  and  used  to  construct 
a  feature  vector  as  shown  in  Figure  23.  The  performance  of  this  feature 
vector  s\as  tested  using  the  radar  images  generated  in  Section  II  and  the 
results  are  presented  in  Section  VI. 


F  qurn  23  Computation  of  feature  vector  using  ranqe  and  cross  ranqe  collapsing 
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Section  V 

CLASSIFIER  DESIGN  AND  OPTIMUM  FEATURE  SELECTION 


The  classifier  algorithm  uses  the  above  measured  feature  vectors 
to  classify  the  target  into  one  of  M  possible  target  classes.  A  review  of  the 
literature  on  pattern  recognition  shows  that  many  techniques  can  be  used 
to  design  such  classifiers.  Among  the  most  common  are  the  nearest  neigh¬ 
bor,  maximum  likelihood,  linearized  Bayes,  and  Fisher's  linear  discrim¬ 
inant  technique.  The  performance  of  classifiers,  designed  using  the  above 
techniques,  depends  on  the  available  learning  samples  and  the  particular 
classification  problem.  Since  this  investigation  is  primarily  concerned 
with  the  analysis  of  the  performance  of  feature  vectors  computed  using  the 
method  of  moments,  no  elaborate  classifier  designs  are  attempted.  Instead 
two  classifiers  are  used:  the  Kth  nearest  neighbor  and  the  Gaussian  classifier. 
These  two  classifiers  and  two  schemes  used  in  reducing  the  dimensionality 
of  the  feature  vectors  are  described  in  this  section. 


5.  1  Kth  NEAREST  NEIGHBOR  CLASSIFIER 


The  nearest  neighbor  classifier  decides  that  a  measured  feature 
vector  X  belongs  to  target  T.  if 


X  -  x(- 1 
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t  h 

a  measured  feature  vector  for  target  ’<  at  the  !••  aspect  angle 
and  X  denotes  the  norm  of  X. 
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A  generalization  of  the  Kth  nearest  neighbor  classifier  is  the  distance 
weighted  Kth  nearest  neighbor  used  for  many  of  the  classification  tests 
described  in  Section  VI.  To  classify  a  measured  feature  vector  X  using 
this  classifier  the  K  nearest  neighbors  of  X  are  found  from  the  training  set 
|  Xj,  X-,  .  .  .  Xp,  |  and  are  ordered  so  that  their  distances  d.  =  ILx  -  X.  1 
from  X  are  increasing 


dl  <  d2  <  •  •  *  <  dK  - 


Using  these  distances,  a  set  of  weights  W.'s  are  computed  as  follows. 
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W.  =1  iff  d..  =  d.  • 
J  K  1 


(55) 


These  weights  are  then  normalized  so  that  their  sum  is  equal  to  unity 
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Since 
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S  W.  =  S  W(m)  =  1.0 
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j=  1  m=  1 

the  class  weights  W*m'  can  be  considered  as  an  estimate  of  p(X/C  I,  and 
the  unknown  target  is  identified  as  target  C  if 

W(m>  =  max  W*n*  >  p  (58) 

n 

where  0  <  p  <  lisa  threshold  used  for  the  decision  of  unknown;  i.  e.  ,  if 
( n. ) 

max  (W  1  <  p  an  unknown  is  declared, 
n 

To  reduce  the  computations  required  for  this  classification  scheme, 
a  technique  developed  by  Friedman,  et  al.  [°]  ,  is  used.  According  to  their 
algorithm,  the  set  of  feature  vectors  from  all  the  classes  are  sorted  on  the 
values  of  one  of  the  coordinates.  Then  for  each  test  vector,  the  training 
feature  vectors  are  examined  in  the  order  of  their  projected  distance  from 
the  test  vector  on  the  sorted  coordinate.  When  this  projected  distance 
becomes  larger  than  the  distance  to  the  Kth  closest  vector  of  those  training 
vectors  already  examined  the  search  stops,  the  K  closest  vectors  of  those 
alreadv  examined  are  those  for  the  entire  training  set. 

5.2  GAL'SSIAX  CLASSIFIER 

The  Gaussian  classifier  is  a  maximum  likelihood  classifier  under  the 
assumption  that  as  the  target  aspect  varies  the  measured  feature  vectors 
X  are  rand'  m  vectors  distributed  according  to  the  multivariate  Gaussian 
density,  ’’nder  this  assumption,  the  classification  algorithm  is  reduced 
t  the  computation  >r  a  quadratic  discriminant  function  given  bv 
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where  the 
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indicates  the  "determinant  of  ",  X.  is  an  estimate  of  the 


mean  value  of  the  feature  vector  X  for  the  jth  target  and  is  an  estimate 
of  the  covariance  matrix  of  X  for  the  jth  target.  To  obtain  these  estimates, 
a  set  of  N  learning  samples  of  the  feature  vector  X  is  used  to  represent  each 
target  over  a  range  of  aspect  angles.  This  set  of  feature  vectors  is  repre¬ 
sented  by 


i  =  1,  2,  ...,  X 
j  =  1 ,  2 ,  ....  K 

where  X  is  the  number  of  aspects  and  j  =  l,  2,  ...,  K  indicates  the  class 
or  target  (C.)  membership.  Using  this  training  set,  the  target  means 
are  computed  by 


X 

X  =  yj  V  x|-”  j  =  1,  2 . K  ,  (oU) 

i=i 

and  the  target  scatter  or  covariance  matrices  are 
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Using  these  estimates  of  the  mean  and  covariance  of  the  feature  vector  for 
each  target,  the  quadratic  discriminants  D.bXi  i  -  1....K  of  Equation  (3'1) 
arc  caluateri  for  X  equal  to  the  measured  feature  vector.  The  feature 
"ct  tor  is  then  assigned  to  target  C.  if 

i 

D .  i  X  i  >  D  j  X  i  for  all  .  iTI 


To  allow  for  the  rejection  of  an  unrecognizable  feature  vector,  two 

additional  tests  are  performed  before  the  vector  X  is  assigned  to  target  C.. 

2  - 

The  first  test  is  based  on  Hotelling's  generalized  T“  statistic,  [10 J  which 
is  given  by 


T2  =  (X  -  X.)T  S71  (X  -  X.) 

i  J  J 


If  the  dimensionality  of  the  feature  vector  X  is  M  and  if  N  training  vectors 

are  used  in  computing  the  mean  X.  and  covariance  S.  for  class  C.  then  the 
K  J  j  J 

statistic 
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is  distributed  according  to  the  central  F  ,  distribution  with  v.  -  M  and  v  , 

1  2 

N-M  degrees  of  freedom  [l  0]  ,  [l  l]  .  So  for  a  confidence  interval  (  1  -  0)  |? 
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For  example,  using  tabulated  values  of  the  F  distribution  [id]  ,  the  results  are 

tr.at  if  the  dimensionality  of  the  feature  vector  is  id  and  if  is  training  vectors 

are  used  then  tor  a  l->7.5  percent  confidence  interval,  (F ,  ,  .(0.°77)  =  5.  77) 
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If  tile  training  set  is  increased  to  d7  feature  vectors,  then  for  the  sann 
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is  maximized  by  X.  The  second  test  is  used  to  safeguard  against  misclassifi- 
cation  of  feature  vectors  that  have  a  high  probability  of  belonging  to  more 
than  one  class  and  is  based  on  the  cost  to  reject  as  compared  to  the  loss 
incurred  for  making  a  substitution  error.  Assuming  that  the  observed 
feature  vector  X  is  to  be  assigned  to  one  of  K  classes  and  denoting  by  a. 
for  i  =  1  .  .  .  K  the  action  of  choosing  class  Ck  and  by  a^.+j,  the  action  of 
rejection,  then  if  \(a./C.)  is  the  loss  incurred  for  choosing  action  a.  when 

J  i  j  *  i 

class  C.  is  present,  the  Bayes  risk  is  given  by 

K 

R(a./X)  =  V  Ma./C.)  p(C./X)  .  (o5) 

i  i  J  J 
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Assuming  that  all  classes  are  equiprobable  and  that 
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From  above,  the  selection  of  the  action  that  minimizes  the  Bayes  risk  is 
equivalent  to  the  selection  of  class  Ck  if 


p(X/C.)  >  p(X/C.)  for  j  =  1,  ...  K 
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Otherwise,  the  decision  to  reject  is  optimum.  Under  the  assumption  that 
all  classes  are  equiprobable  application  of  Bayes  rule  gives 
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and  under  the  Gaussian  density  assumption 


pIC./X)  = 
'  1 


exp  D .  ( X )  -  D.  (X) 
l  t 


where  D.tXi  is  given  by  Equation  (59). 

In  summary  the  Gaussian  classifier  used  in  this  study  assigns  a 

feature'  vector  X  to  class  C.  if: 
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M  =  dimensionality  of  X 

N  =  number  of  training  vectors  for  class  C. 
,3  -  confidence  interval 


and  q  is  a  threshold  on  the  a  posteriori  probability  plC./X)  which  can  be 
expressed  as 
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(To) 


where  \  is  the  loss  incurred  bv  the  decision  to  reject  and  V  is  the  loss 
J*  s 

due  to  a  misclas sification  error. 


3  FEATURE  SELECTION’  USING  A  GENERALIZED  MAHALANOBIS 
DISTANCE 


Since  the  processing  of  high  dimensional  feature  vectors  is  costly 
in  terms  comoutation  time  and  computer  memory  requirements,  the 
d'lmensi  nalitv  -f  the  feature  vector  should  be  limited  to  the  minimum  neces  - 


sarv  •  onsurc-  proper  classification.  A  method  is  described  here  that 
refje.ee'  tile  dime  ns  ional  itv  f  the  feature  vector  bv  selecting  a  subset  f 
itures  after  ranking  the  features  according  t<  their  imm-rtance  as  "g-  -od’ 
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is  the  total  within-class  scatter  matrix 
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is  the  between-classes  scatter  matrix. 
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are  the  class  means  and 
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are  the  vithin-e  las  s  scatter  matrices. 

Substitution  m"  the  above  relations  into  Equation  (7 
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Equation  (78)  is  used  as  a  measure  of  the  interclass  distance.  When  the 
dimensionality  of  the  feature  vector  X  is  less  than  the  total  number  of  avail¬ 
able  features,  the  elements  of  X  are  selected  to  maximize  the  interclass 
:> 

distance  d*-.  Since  the  total  number  of  possible  combinations  of  s  features 
out  of  m  available  features  is 
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which  can  be  very  large 


|for  example  (jgj  =  I010j, 

an  exhaustive  search  is  not  practical.  To  overcome  this  difficulty  Gonzalez 
and  Moret  [8]  developed  a  stepwise  search  procedure  that  selects  features 
sequentially  so  that  at  every  step  the  selected  feature  together  with  those 
already  selected  yield  a  maximum  of  the  Mahalanobis  distance.  This 
method  will  produce  the  optimal  subset  when  the  features  are  statistically 
independent.  When  the  features  are  correlated,  however,  the  interdependence 
of  the  elements  of  the  feature  vector  requires  that  they  all  be  considered 
Together  at  every  step.  Thus  a  stepwise  procedure  may  not  always  yield  the 
ntimal  solution  in  sue}]  eases.  To  speed  this  stepwise  process,  Gonzalez 
me:  M  -ret  [dj  introduced  a  recursive  procedure  for  updating  the  inverse  of 
the  total  within-class  scatter  matrix  W  as  new  components  are  added  to  the 
feature  "ector.  Without  going  through  the  details  of  their  derivation,  the 
result  is  given 


W 


E  - 1 


W.. 

i\ 


,  i 


and  Mj.-.j 


u 


I 

1 

u  ! 

V  1 

»K*I  = 

T 

1 

(w  - 

T  - 1 

z1  WK  Z)  \ 

V  =  -1 

5  WK  Z 

w  ” 1 
K 

+  p(wj<1  Z)  (W 

-1 

K  Z) 

Above  K  is  the  iteration  index  that  should  not  be  contused  with  the  subscript 

*  tn  Equat.on  (78)  indicating  class  member ship.  I'o  oOtam  the  overall 

> 

increment  m  u“  (over  all  classes)  .  .1  Liquation  (78),  the  increment  of 

Equation  (7,))  must  be  summed  over  all  the  classes .  Thus  in  selecting 

) 

an  additional  feature  at  each  step,  only  the  above  increment  in  d**  need  be 
cons  idered. 

n .  4  DIMENSIONALITY  REDUCTION  BY  PROJECTING  THE  FEATURE 
VECTOR  INTO  A  LOWER  DIMENSIONAL  SUBSUAi'E 

In  many  cases  where  all  c-  mpoiients  t  the  mature  vector  are  avail¬ 
able,  a  '  inear  transformation  can  be  used  t<-  reduce  the  dimens  i'  nalitv  t 

feature  "I'l  t'T.  Thus  this  technique  selec  ts  a  subsot  •  .1  dr  ;  matures 

that  ,ir-'  linear  e  mbmatims  f  all  available  feature  s.  One  ad’Mntaue  f 
this  si  hi'ttii'  •  [t-,,.  previously  described  selei  t'L  n  nr  cedure  is  that  a!!  : 

'in  ricna!  itures  contribute  t  •  'he  nerved  !  we  r  Lnims,  r.al  feat  ire 

•  •  r.  A  :  -  ac  •  n>  .ut  a  e  i-  that  all  rv.na'i  features  nvtst  n,  .  mnu'en  >• 
nte  i  ' ' :  r  ■  ■ ' : . 


is  minimized.  Using  the  trace  and  the  cyclic  properties  of  the  trace 
operator,  the  above  can  aLso  be  written  as 


K  N 


J  =  V  \  I  tr(HTx!k'(X(.kl)T  H  -  2tr  (E^  HTX(k,l  r  eJe  , 

.  .  l  11  *  1  K. 


k=  1  i=l 


If  the  elements  of  H  are 
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Section  VI 

RADAR  IMAGE  CLASSIFICATION  RESULTS 

Using  the  imaging  algorithms  described  in  Section  II,  a  set  of  540 
plane  view  images  was  formed  from  the  RATSCAT  data  base  (108  images 
per  target  for  1/3  scaled  models  of  an  F-102,  an  F-15,  a  YF-16,  an  F-5E 
and  an  A -10).  As  mentioned  earlier  the  data  were  collected  at  X  band 
against  1/3  scale  models  using  a  total  of  256  frequency  steps  with  3.4  MHz 
step  size.  For  the  full  size  targets  these  measurements  correspond  to 
S-band  data  with  a  measurement  bandwidth  of  about  256  MHz.  Out  of  the  total 
of  108  images  per  target  the  first  72  images  for  each  target  were  obtained 
using  the  lower  128  frequency  measurements  covering  a  bandwidth  of 
128  MHz  out  of  the  256  MHz  measurement  bandwidth  while  the  last  36  images 
per  target  were  obtained  using  the  upper  128  frequency  measurements. 

The  resulting  range  resolution  on  the  full  scale  targets  is  1.17  meters.  For 
each  image,  a  3  degree  rotation  of  the  target  was  used  resulting  in  a  cross 
range  resolution  of  0.95  meters  on  the  full  scale  target.  The  images  were 
formed  over  the  following  set  of  aspect  angles  0-3  degrees,  5-8  degrees.  .  . 

175  -  178  degrees  and  2-5  degrees,  7-10  degrees.  12  -  15  degrees . 

1  77  -  180  degrees  for  the  first  set  of  128  frequencies  and  for  aspects  of 
0-3  degrees,  5-8  degrees,  ...  175  -  178  degrees  for  the  second  set  of 
128  frequencies.  Examples  of  these  images  arc  shown  in  Figures  24 
through  28. 

The  image s  of  the  F-lll  were  formed  by  C.C.  Chen  [14]  using  data 
obtained  with  the  ALCOR  radar.  The  data  were  recorded  from  a  maneuvering 
F-lll  target  aircraft  using  a  linear  FM  waveform  with  500  MHz  instantaneous 
bandwidth.  The  resolution  of  the  images  from  this  target  was  reduced  to 
match  the  resolution  of  the  RATSCAT  images.  The  images  for  this  target 
were  formed  over  the  following  aspect  angles. 
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0-3  degrees,  5-8  degrees, 

85  -  87  degrees  and  2-5  degrees, 

7-10  degrees .  87  -  90  degrees. 

i 

Examples  of  images  from  this  target  are  shown  in  Figure  29.  All  of  the  above  ^ 

images  correspond  to  top  views  of  the  targets  i.e.  projections  on  the  horizontal 
plane.  From  the  NOSC  data  set  a  small  number  of  images  (10  top  views  and 
10  side  views)  was  obtained  for  a  DC- 10,  and  examples  art1  shown  in  Fig¬ 
ure  13.  Because  this  target  was  moving,  it  was  necessary  to  use  the  full 

256  MIlz  measurement  bandwidth  to  properly  focus  and  align  the  range  1 

signatures  used  in  forming  the  image.  For  classil  ication  tests  only  the  ten 

I 

side  views  obtained  on  tins  target  have  been  used.  These  images  were 
combined  with  a  set  of  ten  side  view  images  obtained  using  RATSCAT  measure¬ 
ments  for  tile  F-5E  and  the  A-10.  The  side  views  on  these  targets,  examples 
of  which  are  shown  in  Figures  9  and  10,  were  obtained  for  a  6.2  degree 
rotation  of  the  target  for  nose  aspects  (-18.2  to  -12.0  degrees,  -15.2  to 
-9  degrees,  -12.2  to  -6  degrees,  -912  to  -3  degrees,  -6.2  to  0  degrees, 

0  to  0.2  degrees,  3.2  to  9.7  degrees,  0.0  to  12.2  degrees,  9.0  to  15.2  degrees, 

12.4  to  18.2  degrees)  using  the  full  25o  Mil/,  measurement  bandwidth  resulting 
m  O.o  meter  range  resolution  and  0.5  meter  cross  range  resolution  on  the 
full  scale  target. 

In  addition  to  the  above  classification  tests  the  classifiers  were 
also  presented  witii  top  view  images  of  the  RATSCAT  targets  obtained  using 
the  full  25o  MHz  bandwidth  and  a  o.2  degree  rotation  of  the  target.  For 
these  tests  24  images  per  target  for  the  five  RATSCAT  targets  were  termed 
over  the  following  set  ol  aspects  (0.8  -  7  degrees,  t> .  8  -11  degrees,  .  .  . 

3  0.8  -  37  degrees,  140.8  -  147  degrees,  146.8  -  1  5  3  degrees . 170.8 

-177  degrees)  and  3.8-  10  degrees,  4.8-  1  0  do  g  r  ee  s ,  ...  33.8-  4(1  degrees, 

14  3.8  -  1  50  deg  rees ,  149.8-  J  56  degrees ,  ...1  7  3.8  -  1  (30  degrees)  and  the 
classifier  was  trained  on  the  first  set  and  classified  the  second.  Examples  of 
these  images  are  shown  in  Section  II. 
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.  First  20  seconds  or  2048  signatures 
(=2.5°  aspect  change) 


b.  Second  20  seconds 


c.  Third  20  seconds 


d.  Fourth  20  seconds 


( 3.1  CLASSIFICATION  PERFORMANCE  OF  FEATURE  VECTORS 
USING  THE  CENTRAL  MOMENTS 

In  this  section  performance  results  are  presented  fur  feature  vectors 


computed  using  moments  from  the  image,  a  combination  of  moments  from 
the  image  and  edge  detected  image  and  moments  from  the  edge  detected 
image.  For  the  classification  tests  the  Kth  nearest  neighbor  classifier  and 

the  Gaussian  classifier  have  been  used.  t\ 

To  avoid  the  problem  of  singular  covariance  matrices  resulting  from 
training  sets  with  a  small  number  of  learning  vectors  as  compared  to  their 
dimensionality,  whenever  the  training  set  was  small  in  comparison  to  the 
number  of  features  the  kth  nearest  neighbor  classifier  was  used. 

For  the  classification  tests  in  this  study  the  measurements  on  the 
targets  ranging  from  0  degrees  (for  nose  aspects)  to  180  degrees  /for  tail 
aspects)  .>n  t he  plan  view  images  were  subdivided  into  either  four 
45  degree  sectors  (0-45  degrees.  45'  oq  degrees.  Q|)  -  1  3 '  degrees. 

1  3  5  -  180  degrees)  or  three  h0  degree  sectors  t  0  -  h0  degrees.  '  0  -  12  0  degrees. 

120  -  180  degrees).  In  each  case  the  classifiers  were  trained  and  touted 
on  a  per  sector  basis. 

For  classification  using  the  central  moments  from  the  image  and  from 
the  edge  detected  image  all  moments  of  orders  2  to  I  were  computed  giving 
a  total  number  of  33  central  moments.  For  the  classification  tests  using 
the  Kth  nearest  neighbor  for  the  plan  *  :,-w  -maces  with  1.  i?  meter  range 
and  0.0'  meter  cross  range  resolution  the  classifier  was  trained  using 
3n  images  per  target  obtained  using  the  lower  I2.w  frequence  steps  over 

• :  i  '  -  "  -  *i  < i i ■  g  r  <■  e  s  ,  -  -  ^  d c g  r •  ■  •  •  «  .  ...  I  7  -  -  1  ~  •>  deg  » -  . 

i  r  i  n  g  7  2  :  u .  i  g  •  ■  >  o  ■  ■  r  • .  t  r  g  •  •  t .  •.  he  r>‘  •  .  •  g  •  •  -  ■  ■  •  r  <■ 

'/  :tu;  ■ t  .i  i : .  •  a  I  2  :  r  .  -t.u»'  :-.r  u.i'.t  •  ■  i  1  '  i  :  ■ 
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the  F-lll  was:  f^O’  ^02’  ^40'  ,122’  ^30’  ^31’  ^60‘  ^70’  ^12’  ,x41’  ^5 1 ' 
y-24'  '•'"here  the  first  index  corresponds  to  range  and  the  second  to  cross 
range.  The  corresponding  ranking  of  the  best  12  central  moments  from  the 
edge  detected  image  Ls^q,  H4Q.  n22,  U6Q.  F3}.  H30-  P5Q.  h£4.  t^04- 

^0o’  ^4  >  •  Figures  30  and  31  show  the  classification  performance  obtained 
using  all  33  moments  from  the  image.  Figures  32  and  33  show  the 
classification  performance  obtained  when  the  best  12  moments  from  the 
image  and  the  best  12  moments  from  the  edge  detected  image  are  combined 
to  form  a  24  element  feature  vector.  These  figures  show  the  performance 
is  of  the  order  of  50  to  65  percent.  However,  when  the  elements  of  the 
feature  vector  obtained  using  the  24  moments  (best  12  from  image  and  best 
12  from  edge  detected  image)  are  normalized  bv  their  standard  deviation 
over  all  targets  and  aspects  the  kth  nearest  neighbor  classification  results 
arc  of  the  order  of  80  to  97  percent  as  seen  in  Figures  34  and  ■>  > .  Fig¬ 
ures  35  through  38  show  a  detailed  tabulation  of  the  classification  results 
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Fgure  31.  Classification  results  for  33  moments  from  image  intensity  (1m  resolution  plan  views  6  classesl 
using  kth  nearest  neighbor  (with  unknown),  for  45°  and  60°  sectois. 
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Figure  33.  K-th  nearest  neighbor  classification  results  (1m  resolution  plan  views  6  classes)  for  24  moments  (12 
best  from  image  and  12  best  from  edge  detected  image)  (with  unknown)  for  45°  and  60°  sectors. 
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P  q.jr<:  34  K-th  nearest  neighbor  classification  results  1 1m  '"solution  plan  views  6  classesi  tor  24  moments 

(12  best  from  imaqe  and  12  best  from  edge  detected  image)  normalised  by  their  standard  deviations 
for  K  -  6  and  no  unknown  class. 
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Figure  35.  Kth  nearest  neighbor  classification  results 
(1m  resolution  plan  view  images)  for  K  =  6 
for  24  moments  (best  12  from  image  and 
best  12  from  edge  detected  image)  normalized 
by  their  standard  deviations  for  0°  to  45° 
aspect  angles  (0°  is  nose-on).  Threshold  for 
unknown  =  0.0. 


Figure  36.  Kth  nearest  neighbor  classification  results 
|1m  resolution  plan  view  images)  (or  K  =  6 
for  24  moments  (best  12  from  image  and 
best  12  from  edge  detected  image)  normalized 
by  their  standard  deviations  for  45°  to  90° 
aspects.  Threshold  for  unknown  =  0.0. 
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F  guie  3’  Kth  nearest  neighbor  classification  resuits 
t  'm  resolution  plan  vtewsl  *ot  K  =  6  for 
24  moment;  (best  12  from  image  and  best 
12  from  edqe  detected  imaqel  normalized 
by  their  standard  deviations  for  90°  to 
1  35°  aspects  Threshold  for  unknown 
*  0  3 


F  qure  38  Klti  nearest  neighbor  Classification  results 
I'm  resolution  plan  views!  for  K  6  for 
24  moments  (best  12  from  image  and  best 
12  from  edge  detected  imagel  normalized 
by  their  standard  feviations  for  135°  to 
180°  aspects  Threshold  tor  unknown  - 
0  0 
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Figure  40.  Kth  nearest  neighbor  classification  results 
(1m  resolution  plan  views)  for  K  =  6  for 
24  moments  (best  12  from  image  and  best 
12  from  edge  detected  image)  normalized 
by  their  standard  deviations  for  0°  to  45° 
aspects.  Threshold  for  unknown  =  0.5. 


%  UNKNOWN:  31% 

Figure  41.  Kth  nearest  neighbor  classification  results 
(1m  resolution  plan  views)  for  K  =  6  for 
24  moments  (best  12  from  image  and  best 
12  from  edge  detected  image)  normalized 
by  their  standard  deviations  for  45°  to 
90°  aspects.  Threshold  for  unknown  * 
0.5. 
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F  pure  42.  Kth  nearest  neighbor  classification  results 
1 1m  resolution  plan  viewsi  for  K  =  6  for 
24  moments  Ibest  12  from  image  and  best 
12  ‘ram  edge  detected  imaqel  normalized 
by  their  standard  deviations  for  90°  to 
135°  aspects.  Threshold  -  0  5 


Figure  43  Kth  nearest  neighbor  classification  results 
llm  resolution  plan  viewsi  for  K  -  8 
for  24  moments  (best  12  from  .mage  and 
best  12  from  edqe  detected  image  for  135° 
to  180°  aspects.  Threshold  for  unknown 
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%  CORRECT  DECISION:  90% 

Figure  44.  Kth  nearest  neighbor  classification  results 
(0.5  meter  resolution  plan  views)  for 
K  =  5  for  24  moments  (best  1 2  from  image 
and  best  12  from  edge  detected  image) 
normalized  by  their  standard  deviations 
for  0°  to  40°  aspects.  Threshold  =  0.0. 


%  CORRECT  DECISION:  96% 

%  UNKNOWN  -  10% 

Figure  45.  Kth  nearest  neighbor  classifications  results 
(0.5  meter  resolution  plan  views)  for 
K  =  7  for  24  moments  (best  12  from  image 
and  best  12  from  edge  detected  image) 
normalized  by  their  standard  deviations 
for  0°  to  40°  aspects.  Threshold  =  0.5. 
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Figure  46.  Kth  nearest  neiohbor  classification  results 
for  K  =  5  for  24  moments  (best  1  2  from 
image  and  best  12  from  edge  detected 
i  mage  I  normalized  by  their  standard 
deviations  for  140°  to  180°  aspects. 


are  shown  in  Tables  3  and  4.  Tables  5  and  b  show  class ification  results 
with  the  Gaussian  classifier  using  three  60  degree  sectors  for  the  best  lb 
moments  from  the  image  and  for  the  best  nine  moments  from  the  image- 
combined  with  the  best  nine  from  the  edge  detected  image.  Tables  7  and  b 
show  clads  if  ication  results  using  the  best  12  moments  from  the  edge  detected 
image  using  the  Gaussian  classifier  with  45  degree  sectors.  In  general,  the 
best  overall  performance  was  obtained  using  the  best  12  moments  from  the 
image  although  for  nose  aspects  the  12-dimensional  feature  vector  using  the 
moments  from  the  edge  detected  image  and  the  feature  vector  using  six 
moments  from  the  image  and  six  from  the  edge  detected  image  did  better. 

Using  10  profile  views  of  the  DC- 10,  F-5E  and  A- 10  and  the  best 
13  normalized  moments  from  the  image,  classification  tests  were  performed 
with  the  kth  nearest  neighbor  rule  for  k  =  4.  The  classifier  was  trained 
using  five  images  per  target  and  was  tested  with  the  remaining  five  per 
target.  A  perfect  score  was  obtained  in  this  test,  and  the  results  are  shown 
in  F igure  47. 
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Figure  47.  Kth  nearest  neighbor  classifier  using  18 

normalized  moments.  Profile  images  with 
0.5  meter  resolution  (nose  aspects), 

<K  =4). 
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TABLE  3.  CLASSIFICATION  RESULTS  FOR  45°  SECTORS  (SECTOR  1  IS 
NOSE  ASPECTS  AND  SECTOR  4  IS  TAIL  ASPECTS)  USING  THE  BEST  12 
OUT  OF  33  MOMENTS  COMPUTED  FROM  THE  IMAGE  INTENSITIES  USING 
THE  GAUSSIAN  CLASSIFIER  WITH  P  -  100  PERCENT  AN  D  q  =  0.0 
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TABLE  4.  CLASSIFICATION  RESULTS  FOR  45°  SECTORS  USING  12 
MOMENTS  (BEST  6  FROM  IMAGE  AND  BEST  6  FROM  EDGE  DETECTED 
IMAGE)  USING  THE  GAUSSIAN  CLASSIFIER  WITH  B  =  99  PERCENT  AND 
q  =  0.  0 
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TABLE  5.  CLASSIFICATION  RESULTS  FOR  60°  SECTORS  FOR  THE  BEST 
18  MOMENTS  OUT  OF  33  (COMPUTED  FROM  THE  IMAGE  INTENSITY) 
USING  THE  GAUSSIAN  CLASSIFIER  WITH  p=  99.5  PERCENT  AND  q  =  0.5 
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TABLE  6.  CLASSIFICATION  RESULTS  FOR  60°  SECTORS  FOR  THE 
BEST  18  MOMENTS  (9  FROM  IMAGE  AND  9  FROM  EDGE  DETECTED 
IMAGE)  USING  THE  GAUSSIAN  CLASSIFIER  WITH  (3=  100  PERCENT  AND 
q  =  0.0  (NO  UNKNOWN) 
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TABLE  7.  CLASSIFICATION  RESULTS  FOR  45°  SECTORS  USING  THE 
BEST  12  OUT  OF  33  MOMENTS  COMPUTED  FROM  THE  EDGE  DETECTED 
IMAGE  USING  THE  GAUSSIAN  CLASSIFIER  WITH  (3  =  100  PERCENT  AND 
q  =  0. 0 


»••••  O  R  5:5  1: 

c:  r  a  r  =ii=  .1. 

TARGET: 

** I DENT I FI ED  AS** 

JT 

-102  F-15  F 

-16 

F-SE 

A- 10 

F- 

ill 

UK 

F-102 

9  0 

(1 

0 

0 

0 

n 

F  -  IS 

0  B 

1 

0 

0 

0 

0 

F  - 1  6 

0  0 

S 

■7 

\J 

i 

0 

(i 

F  -5c 

0  0 

0 

9 

0 

0 

0 

A- 10 

0  0 

0 

0 

9 

0 

0 

F-lii 

0  0 

0 

0 

0 

9 

0 

PROBABILITY  FOR  A  CORRECT  DECISION  98Z 

PERCENT  UNKNOWN 

0: 

i:"  0  R  3  1: 

c:d  t  c:i  r  4i 

"FI?  GET: 

**101.: 

U  f  T  !■  1 

;?>  as** 

■•1.02  F-tS 

••  1 6 

F  GE 

A  •*  t  n 

F  - 

1 1 

IJ  • 

•:r  .  .  n  '  ■> 

t  V.  1 

9  a 

A 

3 

\\ 

•> 

•» 

i.  •> 

0  s 

A 

p 

0 

1 

! 

F- <  A 

0  1. 

? 

n 

P 

0 

0 

1—  r**"  ■"* 

«  - 

1.  0 

O 

□ 

0 

0 

0 

A  - 1 ' 

:•  ■.) 

0 

:) 

0 

0 

n 

F  ■  1  •  1. 

)  :i 

n 

0 

p 

1; 

PROBABILITY  FOR  A 

TORRE"  DECISION  ?SZ 

PERCEN’  UNKNOWN 

9Z 

— 

r  0  R  3  V: 

::  * *r  0  r  if  vs 

rjr:  ** 

y  {•:  [  y 

vr  .:r  r 

■  1  *  'V  ^ 

r 

F  -■  1 7.  F 

-  4i  6 

F-SE 

A  -10 

r 

1. 1 1 

■JK 

,r  142 

7  1 

<\ 

{; 

I: 

:> 

!■ 

“  .  4  C 

:) 

0 

•> 

r 

0 

0 

0 

;! 

0 

:1  '  i  i  1 


- 1. 1  ’ 

’robabilit''  -or  a  decision 

°E»CZN*  UNKNOWN 

1  C.  iR  • . :  1  .  1  .  1  i.JJv* 

1 

"I 

II 

n  1; 

.) 

t  :r  ”  ; 

r  •  ■  0;’  r 

i  >1  m  '  :■  1 

1  '■  V  V 

«  *  "•’  \  u 

u 

* 

u 

'( 

! 

0 

’  1 

I- 

p*3mbi.:ty  for  a  correct  decision  ,3: 
•a!.'RC-r  UNKNOWN  3: 


90 


I 


( 


TABLE  8.  CLASSIFICATION  RESULTS  FOR  45°  SECTORS  USING  THE 
BEST  12  OUT  OF  33  MOMENTS  COMPUTED  FROM  THE  EDGE  DETECTED 
IMAGE  USING  THE  GAUSSIAN  CLASSIFIER  WITH  f3  =  99  PERCENT  AND 
q  =  0.0 
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6.2  CLASSIFICATION  RESULTS  USING  INVARIANT  MOMENT  FUNCTIONS 


As  described  in  Section  III  some  algebraic  relations  among  the 
central  moments  of  an  image  are  invariant  with  respect  to  rotations  of  the 
image  in  the  image  plane.  These  relations  are  known  as  orthogonal  invariant 
moment  functions  and  have  been  proven  to  be  a  usefull  feature  for  shape 
recognition  in  photographs  and  FLIR  images.  As  described  in  Section  III 
and  Appendix  A,  33  orthogonal  moment  invariants  were  computed  using  all 
central  moments  of  orders  2  to  7.  Orthogonal  moment  invariants  were 
computed  using  both  the  image  and  the  edge  detected  image.  The  invariant 
moment  functions  were  ranked  in  terms  of  their  importance  as  classification 
features  using  the  Mahalanobis  distance  criterion  described  in  Section  5. 

The  resulting  ordering  was  the  same  for  both  the  invariants  from  the  image 
and  the  invariants  from  the  edge  detected  image.  This  ordering  is: 

P21,PZ9t  pl’  PZ’  p3’  p4’  P 5’  pb'  Pl'  p8*  p9‘  p10’  p18’  P17’  PZ2‘  PZ 8’  p2i’ 
P^q,  where  the  invariants  p.  are  defined  in  Appendix  A. 

Using  a  24-element  feature  vector  obtained  by  combining  the  best 
12  invariants  from  the  image  and  the  best  12  invariants  from  the  edge 
detected  image  classification  tests  were  performed  against  the  1  meter 
resolution  plan  view  images  of  the  five  RATSCAT  aircraft  models  and  the 
F-lll.  For  these  tests  the  kth  nearest  neighbor  classifier  was  used.  The 
results  are  summarized  in  Figure  48.  The  training  set  for  the  RATSCAT 
targets  consisted  of  36  images  per  target  formed  by  using  the  first  set  of 
128  frequency  steps  over  the  following  set  of  aspects  0  to  3  degrees,  5  to 
8  degrees,  .  .  .  175  to  178  degrees.  The  testing  set  consisted  of  72  images 
per  target,  where  36  were  obtained  from  the  same  set  of  128  frequency  steps 
for  data  collected  from  aspects  2  to  5  degrees,  7  to  10  degrees,  ...  177  to 
180  degrees);  36  additional  images  were  obtained  from  the  next  128  frequency 
steps  (out  of  the  total  25o  steps  used  for  data  collection)  for  aspects  (0  to 
3  degrees,  5  to  8  degrees,  ...  175  to  178  degrees).  The  training  set  for  the 
F-lll  images  obtained  using  the  ALCOR  radar  data  consisted  of  images 
formed  over  the  following  set  of  aspects  (0  to  3  degrees,  5  to  8  degrees, 

...  85  to  87  degrees).  The  testing  set  for  this  target  consisted  of  images 
formed  over  the  set  of  aspects  (2  to  5  degrees,  7  to  10  degrees, 
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ASPECT  ANGLE 

Figure  48.  Classification  performance  of  24  invariants  (best  12  from  image  and  best  12  from  edge  detected 
image)  with  the  kth  nearest  neighbor.  Invariants  were  normalized  by  the  radius  of  gyration. 

.  .  .  S7  to  q0  degrees).  Figure  49  summarizes  the  class  if  ication  results  lor 
the  best  12  invariants  from  the  image  using  the  kth  nearest  neighbor  rule 
and  Figure  50  summarizes  the  results  obtained  using  the  kth  nearest  neighbor 
with  a  feature  vector  made  up  of  the  six  best  invariants  from  the  image  and 
the  six  best  invariants  from  the  edge  detected  image.  Results  obtained  using 
the  Gaussian  classifier  with  the  best  Id  and  best  17  variants  from  the  image 
anu  also  with  the  best  six  and  six  invariants  (image  and  edge  detected  image) 
and  with  the  best  nine  and  nine  are  tabulated  in  Tables  through  Id.  For 
the  above  classification  tests  the  invariant  moment  functions  were  normalized 
uv  the  factor  rK  where  r  is  the  radius  of  gyration  defined  in  Equation  (dS) 
and  the  nov.er  .  denencis  on  the  order  of  the  invariant  and  is  obtained  using 
the  algorithm  described  in  Annendix  A.  Some  classification  tests  were  also 
•serf  if  rued  where  the  invariants  were  normalized  bv  their  standard  deviations 
(  wr  all  a  snoot  s  and  targets)  rather  than  bv  the  :><  wers  of  the  radius  ot 
_  v  ra  t :  •  ■  n  .  Figure  Si  shows  the  classification  no  r  fo  ru.an.o  o  obtained  using  the 
id  list  n  .finalized  invariants  from  the  image  and  Id  best  normal  i. ted  invariant 
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Figure  49.  Classification  performance  of  best 
12  invariants  using  kth  nearest 
neighbor  classifier.  Invariants 
normalized  by  radius  of  gyration. 
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Figure  50.  Classification  performance  of  12 
invariants  (best  6  from  image  and 
best  6  from  edge  detected  image) 
using  kth  nearest  neighbor 
classifier.  Invariants  normalized 
by  radius  of  gyration. 
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Figure  51.  Classification  results  11m  resolution  plan  views  6  targets) 
using  the  kth  nearest  neighbor  with  24  invariants  (12  best 
from  image  and  12  best  from  edge  detected  image) 
normalized  by  their  standard  deviations  rather  than  by 
powers  of  the  radius  of  gyration. 
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TABLE  11.  CLASSIFICATION  RESULTS  FOR  60  SECTORS  FOR  THE 
BEST  17  INVARIANTS  FROM  THE  IMAGE  USING  THE  GAUSSIAN  CLASSIFIER 
WITH  p  =  99  PERCENT,  q  =  0.0 
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TABLE  12.  CLASSIFICATION  RESULTS  FOR  THE  BEST  18  INVARIANTS 
(9  FROM  IMAGE  AND  9  FROM  EDGE  DETECTED  IMAGE  USING  THE 
GAUSSIAN  CLASSIFIER  WITH  P  =  99  PERCENT  AND  q=  0.0 
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from  the  edge  detected  image.  By  comparing  these  results  in  Figure  51  to 
those  of  Figure  48  obtained  for  the  invariants  that  were  normalized  by  the 
radius  of  gyration,  an  average  improvement  is  seen  in  classification  perform¬ 
ance  of  the  order  of  30  percent.  Using  the  3  3  invariants  obtained  from  the 
image  without  any  normalization  an  optimum  transformation  matrix  H  was 
computed  as  described  in  section  5.4  and  the  33  dimensional  vector  of  the 
invariants  was  projected  into  a  5  dimensional  subspace.  The  resulting 
5  dimensional  feature  vector  was  used  to  classify  the  five  RATSCAT  targets 
using  the  Gaussian  classifier.  The  results  are  given  in  Table  13.  From  this 
table,  classification  performance  is  seen  to  be  86  percent  for  nose  aspects 
and  75  percent  for  tail  aspects,  for  the  1  meter  resolution  plan  view  images. 

As  seen  in  the  figures  and  tables  tabulating  the  classification  perform¬ 
ance  for  the  invariant  moment  functions,  the  best  results  for  the  kth  nearest 
neighbor  tests  are  of  the  order  of  51  percent  to  80  percent  correct  shown  in 
Figure  51.  Comparing  these  results  with  those  corresponding  to  classification 
using  the  moments  (Figure  34),  the  central  moments  give  on  an  average 
10  percent  better  results.  The  same  trend  favoring  the  feature  vector  from 
the  moments  over  that  of  the  invariants  is  observed  by  comparing  the  results 
obtained  using  the  feature  vector  formed  by  the  best  18  invariants  from  the 
image  and  the  corresponding  feature  vector  formed  using  moments.  By 
comparing  the  results  in  TabLe  11  with  those  of  Table  5,  the  aeriormance 
is  about  the  same  for  both  features  for  nose  aspects  but  for  all  other  asoects 
the  feature  vector  using  the  central  moments  g ives  10  to  15  percent  better 
results.  Thus  the  tests  show  that  the  moments  perform  much  better  than  the 
oivar  lants  . 

o.3  CLASSIFICATION  RESULTS  USING  GENERAL  ALGEBRAIC  INVARIANT 
MOMENT  FUNCTIONS 

In  our  discussion  „f  invariant  moment  functions  a  set  of  relations 
amonc  the  moments  of  an  image  that  are  invariant  with  respect  to  general 
Coordinate  transormations  Acre  presented  ,n  Equations  32  through  38, 

These  functions  of  the  moments  are  invariant  with  respect  to  both  rotations 
and  non  an. form  scale  chances  of  the  coordinates  thus  thev  are  particular  i  v 


suitable  for  the  recognition  of  inverse  SAR  images  where  the  cross  range 
scale  may  not  be  known  accurately.  For  the  classification  tests  using  these 
general  algebraic  invariants,  only  the  three  general  invariants  obtained  by 
Hu  Tt]  and  repeated  in  Equations  32  through  35  were  used.  With  these 
formulas,  three  general  invariants  from  the  image  and  three  from  the  edge 
detected  image  were  computed  and  used  to  form  a  six-dimensional  feature 
vector.  This  feature  vector  was  then  used  to  classify  the  plan  view  images 
obtained  from  the  RATSCAT  targets  and  the  results  for  the  1  meter  resolu¬ 
tion  images  are  presented  in  Table  14.  As  seen  in  this  table  the  performance 
of  this  feature  vector  is  poor  (46  to  62  percent  correct).  The  main  reason 
for  this  poor  performance  is  probably  the  low  dimensionality  of  the  feature 
vector.  In  an  attempt  to  improve  the  performance  of  the  above  features 
without  deriving  new  formulas  to  compute  higher  order  general  invariants,  the 
dimensionality  of  the  feature  vector  was  increased  from  o  to  2  7  by  including 
the  squares  and  by  two  products  of  the  components  of  the  original  b  dimensional 
feature  vector.  Then  as  described  in  Section  5.4,  a  transformation  matrix 
was  obtained  to  reduce  the  dimensionality  of  this  new  27  dimensional  feature 
vector  down  to  5.  The  Gaussian  classifier  was  then  trained  and  tested  using 
this  5  dimensional  feature  vector  and  the  results  are  tabulated  in  Table  15. 

The  results  are  still  not  too  good  (66  to  71  percent  correct),  although  there 
is  some  improvement  over  the  results  of  Table  14  for  all  aspects. 

o.4  CLASSIFICATION  RESULTS  USING  RANGE  AND  CROSS  RANGE 
COLLAPSING 

As  described  in  SectLon  IV,  the  target  orientation  in  the  image  olane 
is  estimated  using  Equation  (39)  and  the  co-ordinate  axes  are  rotated  so 
that  the  v-axis  (range)  lines  up  with  the  fuselage.  The  intensity  distribution 
of  the  image  is  then  averaged  along  the  x  and  y  axes  to  oroduce  average 
v-axis  and  x-axis  intensity  oroides.  A  feature  vector  is  then  computed  using 
the  c  irrelation  coefficients  for  each  of  these  two  profiles  as  shown  in  Fig¬ 
ure  2  .  Using  the  I  meter  resolution  images,  the  first  15  correlation 
c  ■  < •  f f invents  were  commuted  from  the  x-axis  and  the  v-axis  intensity  oroides. 

\'s  .r.g  the  Mahalanobis  distance  criterion,  the  correlation  coen  icients  were 
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TABLE  13.  CLASSIFICATION  RESULTS  for  45°  SECTORS  FOR  A 
FEATURE  VECTOR  OBTAINED  BY  PROJECTING  INTO  A  5  -  DIMENSION  A  L 
SUBSPACE  THE  33  ELEMENT  INVARIANT  FUNCTIONS  VECTOR  OBTAINED 
FROM  THE  IMAGE  INTENSITY  DISTRIBUTION. 
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TABLE  14.  CLASSIFICATION  RESULTS  FOR  SIX  GENERAL  ALGEBRAIC 
INVARIANTS  (I  FROM  IMAGE  AND  >  FROM  THE  EDGE  DETECTED  IMAG 

USING  THE  GAUSSIAN  CLASSIFIER  (NO  UNKNOWN) _ 
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TABLE  15.  CLASSIFICATION  RESULTS  FOR  A  FEATURE  VECTOR 
COMPUTED  BY  INCLUDING  THE  SQUARES  AND  BY  TWO  PRODUCTS 
OF  THE  SIX  GENERAL  INVARIANTS  (3  FROM  IMAGE  AND  3  FROM 
EDGE  DETECTED  IMAGE)  AND  THEN  PROJECTING  THE  RESULTING 
27  DIMENSIONAL  VECTORS  ONTO  A  5-DIMENSIONAL  FEATURE 
VEC  TOR 
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ranked  and  the  resulting  ordering  for  the  best  24  was  found  to  be: 


R  (1).  R  (2).  Rx(l).  Rx(2).  Ry{3),  Rx(3), 

Rx(4),  R x ( 5 ) ,  Ry(14),  R  (13),  Ry(7).  R  (12), 

R  (4),  R  (9).  R  (8),  Rx(15),  R  (14),  R  ^  ( 1  3 ) . 

R x ( 1 0 ) ,  Rx(8),  Rx(b),  Rx(12),  Rx(7),  R^(9) 

where  y  is  the  co-ordinate  along  the  fuselage  and  x  is  the  co-ordinate  parall 
to  the  wings.  The  classification  performance  of  a  feature  vector  using  all 
30  correlation  coefficients  was  tested  using  the  kth  nearest  neighbor  rule 
and  the  results  are  presented  in  Figure  52  The  classification  performance 
for  the  best  24  correlation  coefficients  and  the  best  12  was  also  tested  and 
the  results  of  the  order  of  70  to  88  percent  correct.  These  are  comparable 
to  many  of  the  results  obtained  using  the  central  moments  but  are  about 
10  percent  below  the  best  performance  results  obtained  using  the  best  24 
moments  (best  12  from  image  and  best  12  from  edge  detected  image). 


90  135  180 
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Figure  52.  Classification  performance  using  Kth  nearest  neighbor 
for  30  correlation  coefficients  from  collapsed  images. 


Section  VII 
CONCLUSIONS 


Summarizing  the  results  presented  in  Section  VI,  it  can  be  observed 
that  in  general  the  best  performance  results  were  obtained  usi.ng  feature 
vectors  constructed  from  the  moments  of  the  image  and  the  edge  detected 
image.  For  the  plan  view  images  of  the  six  aircraft  targets  (F-102,  YF-lo, 
F-15,  F-5E,  A-10  and  F-lll,  the  performance  results  for  a  24-element 
feature  vector  constructed  using  12  best  moments  from  the  image  and  12  best 
moments  from  the  edge  detected  image  are  in  the  range  of  84  to  96  percent  as 
seen  in  Figure  39  which  is  repeated  here  in  Figure  55.  Using  the  dimen¬ 
sionality  reduction  procedure  described  in  Subsection  5.4,  a  5-element  feature 
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Figure  55.  Kth  nearest  neighbor  classification  results  11m  resolution  plan  views  6  classes)  for  24  moments  1 1 2 
best  from  image  and  12  best  from  edge  detected  image)  normalized  by  their  standard  deviations 
with  provision  for  unknown. 
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vector  was  constructed  by  projecting  into  a  5-dimensional  subspace  the  33 
element  moment  vector  obtained  from  the  image  intensity.  The  classification 
performance  of  this  feature  vector  was  tested  using  the  1-meter  resolution 
plan  view  images  of  the  five  RATSCAT  targets  and  the  results  are  shown  in 
Table  16.  In  general  as  shown  in  the  results  in  Section  VI,  the  best 
classification  performance  obtained  using  the  invariant  functions  was  about 
10  to  15  percent  below  the  best  results  obtained  using  the  moments.  In 
general  the  tests  showed  that  moments  from  the  image  did  better  than  moments 
from  the  edge  detected  image,  but  feature  vectors  using  combinations  between 
the  two  sets  had  a  high  classification  performance. 

The  observed  classification  results  with  feature  vectors  obtained  by 
averaging  the  image  intensity  along  two  orttogonal  axes  (parallel  and  normal 
to  the  fuselage)  and  then  computing  the  autocorrelation  function  was  70  to 
88  percent  which  is  10  percent  less  than  the  results  obtained  using  the  central 
moments.  Since  the  computational  requirements  for  the  construction  of 
this  feature  vector  are  considerably  smaller  than  the  computational  require¬ 
ments  for  obtaining  the  geometric  moments  and  invariants,  this  feature 
vector  may  prove  useful  in  cases  where  classification  accuracies  of  the 
order  of  70  to  88  percent  are  sufficient. 

In  general,  the  results  from  the  performance  tests  conducted  during 
this  study  are  encouraging  and  suggest  that  the  geometric  moments  may  Drove 
to  be  important  features  for  the  application  of  statistical  pattern  recognition 
techniques  to  the  identification  of  aircraft  targets  from  radar  images.  How¬ 
ever,  because  a  limited  set  of  imaging  geometries  (only  plan  views  cor¬ 
responding  to  projections  on  the  horizontal  plane  for  zero  roll  and  profiles 
corresponding  to  projections  on  the  vertical  plane)  was  used  in  this  study  the 
performance  of  the  techniques  as  a  function  of  roll  and  pitch  angles  was  not 

investigated.  Furthermore,  it  was  assumed  that  the  imaging  plane  was  '  nmui. 
r>.  .  .  .  ( 

.  :e  u. ■termination  of  the  target  view  presenter)  by  the  image  is  an  important 
nrnniem  tnat  needs  to  be  solved  before  the  above  recognition  techniques  can 
>’  used  in  a  vompleteU  unsupe  rvi  sed  mode.  This  problem  will  be  acd  t*e«-  --ed 
; :  1 1  low  -  n  "  re  !  r.  ‘  hi  -  a  re;, . 
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TABLE  It.  CLASSIFICATION  RESULTS  FOR  45°  SECTORS  FOR  A  FEATURE 
VECTOR  OBTAINED  BY  PROJECTING  INTO  A  5- DIMENSIONAL  SUBSPACE 
THE  33  ELEMENT  MOMENT  VECTOR  OBTAINED  FROM  THE  IMAGE 
INTENSITY  DISTRIBUTION. 
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APPENDIX  A 


ORTHOGONAL  MOMENT  INVARIANTS 
by  Jon  P  Belleville 


I 


A.  1 .  INTRODUCTION 

One  of  the  more  difficult  problems  in  the  design  of  a  system  to 
recognize  objects  from  their  images  is  the  selection  of  a  set  of  appropriate 
numerical  features  to  be  extracted  from  the  shape  of  interest  for  purposes 
of  classification.  Such  a  set  of  features  that  has  been  successfully  applied 
to  the  recognition  of  optical  pictures  is  a  set  of  invariant  moment  func¬ 
tions  Cl],  [:],  [>].  which  are  discussed  in  this  appendix. 

A.  2.  MOMENTS 

The  two-dimensional  (pfq)th  order  moments  of  an  intensity  distribu¬ 
tion  function  f(x,  yl  are  defined  by 


?T 


xP  yq 


f(x,  y)  dxdy 


p,  q-  0 ,  1 


It  is  assumed  that  f(x,  y)  is  a  piecewise  continuous  and  therefore  bounded 

function,  and  that  it  can  have  nonzero  values  only  in  the  finite  oart  of  the 

xv  plane;  then  moments  of  all  orders  exist  and  the  following  uniqueness 

theorem  can  be  proved.  Theorem:  the  double  moment  sequence  j  :_lpq  }■ 

uniquely  determined  by  f(x,  y > ;  and  conversely,  f(x,  v)  is  uniquely  determined 

by  jn  i  .  It  should  be  noted  that  the  finiteness  assumption  is  important; 

otherwise  the  theorem  might  not  hold.  It  can  be  shown  that  this  theorem 

holds  in  the  discrete  case  as  well.  In  the  discrete  case  the  ( p  — q )  th  order 

moments  of  an  NxM  rectangular  imase  field  f(x.,v.)  are  defined  bv 

i  '  i 
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pq 
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fix.,  v . )  ( x .  >  P I  v  . ' q 
'  J  '  '  J 


■  here  ix^  yjt  a’-e  the  c  oo  rrli  nate  s  of  the  ji, 
intensitv  function. 


cell  and  t(x.,v.i  is  the  imace 
l  i 


A  -  1 
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The  central  moments  for  the  same  rectangular  image  field  are 
defined  by 


NT  M 


pq 


=  T'  fix. ,  v.)(x. -x)P(v. 
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where: 
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and 
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The  normalized  central  moments  are  defined  by 
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pq 


pq  ™ 


00 


iA-2  I 


and  are  invariant  with  respect  to  changes  in  the  image  intensity.  In  what 
follows,  bv  moments  w  e  refer  to  these  normalized  central  moments. 

To  see  that  the  normalized  moments  are  invariant  with  respect  to 
changes  in  image  intensity  let  a(x,  yi  -  c-f(x.  vi,  where  c  is  some  non-zero 
constant.  Then  Letting  the  primed  moments  be  those  computed  trom  g(x.  v » : 


Thus  m 

pq 


c 


pq 


and  from  Equation  (2 -2  I 
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n 


‘00 


c  m 


00 


pq 


which  demonstrates  that  the  normalized  iroments  are  invariant  with  respect 
to  uniform  changes  in  intensity.  Also  that  the  central  moments  and  normal¬ 
ized  central  moments  are  invariant  with  respect  to  translations,  as  seen  by 
examining  Equation  (A  -  1 ) . 

A.  3  ALGEBRAIC  FORMS  AND  INVARIANTS 
A  .  3  .  1  De  finitions 

The  set  of  moments  developed  above  are  invariant  under  translations 
and  image  intensity  changes.  However,  since  images  may  have  any  orienta¬ 
tion  in  the  image  plane  a  set  of  f  atures  which  remains  constant  under 
rotation  of  the  image  is  desirable.  Such  a  set  has  been  developed  by  Hu[l]  , 
and  is  presented  below. 

First,  some  definitions  and  results  will  be  stated.  The  following 
homogeneous  polynomial  of  two  variables  u  and  v, 


is  called  a  binary  algebraic  form,  or  simply  a  binary  form,  of  order  p. 
Using  a  notation,  introduced  b\  Cavley,  the  above  form  may  lie  ■>  ritten  Cl] 
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I  a  ; 
po 


P-1,  I:  ' 


a 

op 


Hu,  V  i 


P 


A  homogeneous  polvnomial  1(a)  of  the  coefficients  a  ....  a  is  an  ah 

po  op 

braic  invariant  of  weight  \v,  ^1]  if 


Ha'  .  .  .  ,  a'  '  =  A  I  (a  ....  a  ), 
po  ,  op  po,  op 

where  a'  .  .  .  ,  a'  are  the  new  coefficients  obtained  from  substituting 
po,  '  op 

the  following  general  linear  transformation  into  the  original  form  (A-3). 


u  ,  a  y  u'  A  ,  a  Y  {O' 
,vj  U  6J  Lv'J  0  6 


(A -4) 


If  w  -  0,  the  invariant  is  called  an  absolute  invariant:  if  w  *  0  it  is  called  a 
relative  invariant. 

In  the  studv  of  invariants,  it  is  helpful  to  introduce  another  pair  of 
variables  x  and  v,  whose  transformation  with  respect  to(A-4)  is  as  follows: 


t'H:  fl 


I A -5) 


The  transformation  (A-5)  is  referred  to  as  a  cogredient  transformation,  and 
(A-4)is  referred  to  as  a  cont  rag  redient  transformation.  The  variables  x,v 
are  referred  to  as  covariant  variables,  and  u,  v  as  contrava  riant  variables. 

F he v  satisfy  r lie  following  invariant  relation 

ux  vv  -  u'  x  '  •  v '  v '  . 

I’he  Fundamental  Theorem  of  Moment  Invariants  obtained  bv  llu  [l]  -hated 
a.-  follows: 

If  Hie  algebraic  form  of  order  p  has  an  algebraic  invariant. 


1 1  a'  . a'  '  A  ha  . a  1 

mi  op  po  op 


A -4 


then  the  moments  of  order  p  have  the  same  invariant  hut 
with  the  additional  factor  J  , 


I( 


.  a'  *  -  Ul  AW  l(a  . u  )  . 

e  po  e  op  r*pO  r*op 

where  I J I  is  the  absolute  value  of  the  Jacobian 
of  the  transformation  (A-5). 


A .  '■> .  1  Orthogonal  Moment  Invariants 

In  what  follows  Hu's  Ll3  derivation  of  the  orthogonal  moment 
invariant  functions  is  summarized.  Two  coordinate  systems  (x,  v)  and 
(x'.yM  rotated  relative  to  each  other  by  an  angle  0  are  used.  The  two 
systems  are  related  by  the  orthogonal  matrix  transformation 

x 

V 


cos  0  sin  9 
-sin  9  cos  9j 


whose  Jacobian  ls 


I  Jl 


cos  9 
-sin  9 


sin  9 
cos  9 


•  1 


tine e  |  J  |  - 1  ,  the  moment  invariants  are  exactly  the  same  as  the  algebraic 
invariants.  If  the  moments  are  treated  as  the  coefficients  ol  an  algebraic 

form 
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under  the  c  on!  rag  redie  nt  t  ra  ns  format  ion, 
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then  the  moment  invariants  can  he  derived  by  the  following  algebraic  method. 
If  both  u,  v  and  u1  v1  are  subjected  to  the  transformation; 


pup  in  .pi  4p  in 

LvJ  Li  -iJLvJ  L\"J  “  Li  -i J  |_v'_ 


(A- 7) 


then  the  orthogonal  transformation  is  converted  into  the  following  simple 
relat  ions , 


, -i0  ..  i0 

L  -  l  e  ,  \  -  Y  e 


( A  -  X  ) 


Substituting  ( A  —  7 1  and  (A-8)  into  (A-6),  yields  the  following  identities: 


II  . i  HU,  V>P  =  (u. 


LL  )  (u,  V  r 

°P 


-  (  LL  t 

^  po 


.  M'op'<u'  •  '-'|P 


r'  wt  •  "’®  ,  •  10  ,P 

1  )  1 1  e  ,  \  p  r 


(A -91 


where  I  ....  I  and  I  ....  I"  are  the  corresponding  coefficients 
po  op  po  op  r 

after  the  substitutions.  From  the  identity  in  F  and  V,  the  coefficients  of 

p  -  r  r 

r lit?  \arious  monomials  Fr  V  on  the  two  sides  must  be  the  same, 

F  he  refo  re , 
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In  general: 
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From  the  identity  of  the  first  two  expressions  in  (A-9),  it  follows  that 

I  is  the  complex  conjugate  of  I  . 

p-r,r  ~  jo  j-  *  p .  r. 

A  general  expression  for  I  in  terms  of  the  moments  mav  be 

5  v  p-r,r 

written  as  follows: 


!p-r,  r  (^po;  Mp-2,2;  '  ’  '  Vp-2r,2r)  (l,  l)r; 
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where  i  -  \-l  and  p-2r  >  0, 
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p  =  even. 


It  may  be  noted  that  these  (p-li  I’s  form  a  linearly  independent  set  of  linear 
t  ra  ns  forma  tions  of  the  p's,  and  vice  versa.  This  can  be  rewritten  in  summa¬ 
tion  notation  as  follows; 
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Separating  into  real  and  complex  parts  we  get 
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(A-121 


If  1  and  empty  sums  equal  zero  then  equations  f A  —  1  1  )  and  (A-12)  arc- 

valid  for  p  -2  r  2  0. 

Referring  back  to  equation  (A-lOt  it  can  be  seen  that  ii  the  I's  are 
combined  in  such  a  manner  as  to  eliminate  the  6  dependence,  invariants  are 
formed  with  respect  to  rotation.  For  example  for  p-5  and  r-2  is 

sucii  an  invariant.  This  can  be  seen  by  simply  applying  equation  <  A  -  10'. 
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Furthermore,  since  the  moments  are  invariant  with  respect  to  translation 
and  changes  in  intensity  the  invariants  formed  from  the  I's  also  have  these 
->r>  >pe  rt  ies  . 

A  complete  system  ot  orthogonal  moment  invariants  developed  b\ 
i  i • : i  i  i  .-  listed  below  :or  reten-nce. 

For  the  second-order  moments  the  two  independent  invariants  are 


! !  1 '  *2  0  1 0.? 


For  the  third -order  moments  the  three  independent  invariants  are 


( A  - 1  3  ) 


(I30T12  T  I03I21) 


A  fourth  one  depending  also  on  the  third -order  moments  is 


—  •  (I  1^  -  I  1 

i  u30  12  03^1  • 


(A  - 1  4 ) 


The  first  three  given  by  (A-I31are  absolute  invariants  for  both  proper  and 
improper  rotations  but  the  last  one  given  bv(A-14)  is  invariant  only  under 
proper*  rotation,  and  changes  sign  under  improper*  rotation.  This  will  be 
called  a  skew  invariant.  Therefore  it  is  useful  for  distinguishing  "mirror 
images.  "  One  more  independent  absolute  invariant  may  be  formed  from 
second  and  third  order  moments  as  follows: 


( I  1^ 
21T12 


l02  r2l' 


For  pth  order  moments,  p  >4  we  have  [p/2]  (the  integral  part  of  p/2l 
invariants 

1  1  :  I  ,  .  I.  J  I  ;  .  .  .  . 

poop  p-l,ll,p-l  p-r,rr,p-r 

If  p  is  even,  then 


I  ,  ,  ,  is  also  an  invariant. 

p/  2,  p/2 


A  'imple  rotation  ot  coordinates  !),•  0  is  dotim-d  a-  a  proper  rotation.  .  luie 
r»*  fleet  ion  about  one  of  the  coordinate  i\e>  tuilowed  hv  a  rotation  is  detined 
a  -  an  improper  rotation. 


Combining  the  pth  order  moments  with  the  ip-2)  order  moments  a  set  of 
l  p / Z  —  I  ]  invariants  are  obtained  given  by 


(Ip-l,  1  Io,  p-2  T  ri,  p-1  rp-Z,  O'*  ’ 

(Ip-2, 2  II,  p-3  r2,  p-2  rp-3,  1) . 

(I  I  ,  ,  r  I  I  ,  ,  .  .  ) 

p-r,r  r-l,p-r~l  r,p-r  p-(r-lt,r-l 


p- 2  r  >  0 ,  r  >  1  .  <  A  -  1 5 ) 


Also  by  combining  the  pth  order  moments  with  second-order  moments,  two 
additional  invariants  are  obtained 


L  p/2]  ,  [p/2]  +  1  20 


[p/2]  r  1  ,  |p/2]  1 0 


if  p  is  odd,  and 


^p/2- 1  ,  p/2 -1  *20  Jp/2-l  ,  p/2-  1  J02  ^  ’  'A-Jo 

if  p  is  even.  Therefore  there  are  always  tp~ll  independent  absolute 
invariants . 

The  invariants  thus  far  developed  are  invariant  with  respect  to  trans¬ 
lation.  changes  in  intensity,  rotation  and  reflection.  However,  they  are  nut 
invariant  with  respect  to  scale  changes.  To  adjust  lor  scale  changes  each 
invariant  is  divided  ov  a  factor  ol  r^,  as  done  by  Dudani  <2l.  The  scaling 
fact’ .  r  r  is  de  fined  as 


r  V  *  ^2  0  ^  i)2  *  ’ 

whii  it  is  itself  an  invariant  Inamelv  1 ,  j1  also  known  as  tie-  radius  of  g-  ration 
of  the  figure.  The  value  of  k  depends  upon  'lie  order  ot  the  ; :  ^  used  i . .  term 
t  lie  inva  riants. 


1  A  -  1  •  1  .  -  r : :  e  -tine  i  - 
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A  -  1" 


The  values  of  k  are  as  follows: 


k  =  2p  for  invariants  of  the  form:  I  I 

r  p-r,  r  r, p-r 

k  =  p  for  invariants  of  the  form:  I 

^  p/2,  p/2 

k  =  p-q-n(r-s)  for  invariants  of  the  form:  I  In  +  1 

r  n  pq  rs  qp  sr  . 

This  completes  the  development  of  orthogonal  moment  invariants. 
Hu  Cl]  also  developed  a  set  of  moment  functions  which  is  invariant  under 
general  no  ns  L  ngula  r  algebraic  transformations.  This  set  is  briefly  dis¬ 
cussed  in  Section  .1  of  this  report. 


A.  4  PROGRAMMING  CONSIDERATIONS 


Basically,  the  algorithm  to  compute  the  invariants  will  be  a  straight 
line  program;  the  I's  are  computed  first  and  then  combined  to  form  invariant 
However,  there  are  a  couple  of  points  where  the  program  may  be  optimized. 


First,  not  all  the  I’s  need  to  be  computed  since  I ^  ^  is  the  complex 

conjugate  of  I  .  Second,  the  calculation  of  I  as  per  equa- 

p-r ,  r  p- r,  r 

tion  |  A -11  )  or  |A-12)  may  be  optimized  by  the  use  of  a  recursive 


procedure  for  computing  (  ™  j. 

For  instance,  if  is  known  for  some  value  of  m  and  n  and  we  wish 

to  compute  (assume  that  o  <  n  5  m-l).  By  expanding  and 
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Thus,  the  recursion  relation  is 


/  m  \  _  ( m-n)  .  /m  v 
' n+1/  (n+1)  \  n  / 


A .  4.  1  Program  Verification 

A  program  to  compute  the  orthogonal  moment  invariants  up  to  order 
seven  using  the  results  contained  in  this  appendix  is  presented  in  a  summary 
flow  chart  in  Figure  B-4  in  Appendix  B. 

To  check  that  the  invariants  computed  are  actually  invariant  w  ith 
respect  to  rotation,  a  simple  figure  was  used  and  the  invariants  calculated. 

The  figure  used  is  shown  in  Figure  A-l.  The  invariants  that  were 
calculated  are  listed  in  Table  A-l.  Record  1  contains  the  invariants  for  the 
original  image  and  Record  2  are  those  for  the  rotated  image.  The  two  record 
are  identical.  Because  the  test  figure  is  a  straight  line  which  is  originally 
parallel  to  the  x-axis  all  moments  p.  with  q>0  are  zero.  This  results  m 
many  of  the  invariants  reducing  to  the  same  numerical  value  and  explains 
this  occurrence  .n  Table  A-l. 

The  invariants  in  Table  A-l  are  numbered  as  follows.  (The 
normalization  by  1^  j  is  not  showni 

P1  =  r20  lQZ 


p,  through  p,_  have  the  form: 
1  1  < 


p  -  n .  n  n .  p  • 


•a  here  o  .  4 . 7 .  and  n  •  0,  1  ,  ....  [  p/2J  .  anti  r  x]  indicates  the 

integral  o-  rt  .  >t  '  .  For  the  case  when  p  is  even  1  ..  ,  ,  ,  is  used  instead 


For  the  case  when  o  is  even  1 


■'.anmg  invariant-  were  arbitraniv  labeled  a.-  lollow  s 
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a.  Test  figure 
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b.  Rotated  figure 


THE  NUMBERS  BY  EACH  POINT  REPRESENT  THE 


RELATIVE  brightness  at  that  POINT 


Figure  A- 1 


TABLE  A -1 .  INVARIANTS  BEFORE  AND  AFTER  ROTATION 


Record  1 

Record  2 

( Original) 

(Rotated) 

n 

pn 

1 

O 

o 

1. 00 

0 

c* 

0.248 

0.248 

3 

0.248 

0.  248 

4 

3.  37 

3.  37 

5 

3. 37 

3.  37 

6 

1. 84 

1 . 84 

7 

4.09 

4.09 

8 

4.09 

4.  09 

9 

4.09 

4.  09 

10 

18.  1 

IS.  1 

11 

18.  1 

18.  1 

12 

18.  1 

18.  1 

13 

4.25 

4.  25 

14 

37.  1 

37.  1 

1  5 

3  7.1 

37.  1 

16 

37.  1 

37.  1 

17 

37.  1 

37.  1 

18 

0.  123 

0.  123 

19 

0.  0 

2.29  x  1  0 " 8=  0 .  0 

20 

0.  495 

0,  495 

21 

3.67 

3.  o7 

2.01 

2.01 

23 

2.01 

2.01 

24 

1  5.  b 

15.o 

25 

1  5.  b 

15.o 

2  4.  o 

24.6 

27 

2  4.0 

2  4.  o 

2  8 

2  4.  o 

24.  o 

>  I 

3  •  n  7 

3.  o7 

30 

8 .  18 

8.18 

31 

-.51 

8.51 

~  4 .  2 

74.  2 
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APPENDIX  B 

DESCRIPTION  OF  COMPUTER  PROGRAMS  USED 
FOR  THE  CLASSIFICATION  TESTS 

by  Charles  P.  Dolan 


( 


B.  I  INTRODUCTION 


In  designing  the  software  for  this  study,  an  effort  was  made  to 
modularize  the  routines  and  use  a  uniform  input  output  format  for  all  the 
programs.  Thus  the  same  training  and  classification  routines  could  be 
employed  for  all  feature  vectors  used  in  the  study.  Also  commonality  among 
the  routines  for  computing  the  moments  and  invariants  allowed  efficient 
program  design.  The  flowcharts  and  block  diagrams  in  this  appendix  sum¬ 
marize  the  computer  programs  needed  for  the  computation  of  the  moments 
■and  invariants,  the  normalization  of  the  moments  by  their  standard  devia¬ 
tion  over  all  targets  and  aspects,  the  nearest  neighbor  and  Gaussian  classi¬ 
fiers  and  the  feature  selection. 


t 


Fiqure  B-1.  Flow  chart  of  proqram  tor  computation  of  moments  1 


Fiqure  B  3.  Computer  program  for  normalization  of  moments  bv 
their  standard  deviations 


Figure  3-5.  Training  kth  nearest  neighbor  classifier 


Figure  8-6.  Computer  program  for  the  formation  of  training  files  for  nearest  neighbor  classifier 
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Figure  3-7.  Classification  tests  using  kth  nearest  neighbor  classifier 


Figure  B-8.  Flow  chart  of  kth  nearest  neighbor  classifier  which  performs 
classification  tests  over  multiple  targets  aspect  angle  sectors 
and  values  for  k 
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feature  vector 


Figure  B-11.  Training  Gaussian  classifier 


Figure  8-12.  Computer  program  for  preparation  of  means  and 
covariance  matrices  used  by  Gaussian  classifier 
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Figure  B-13.  Classification  tests  using  the  Gaussian  classifier 


Figure  8  14  Flow  chart  of  computer  program  for  the  Gaussian  classifier 
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THE  F'RST  THRESHOLO  IS  FOR  HOTELLING'S  T2  STATISTIC  COMPUTED  FOR 
CLASS  C,  AND  COMPARED  TO  A  TABLE  LOOK  UP  FROM  THE  F  DISTRIBUTION 
THE  SECONO  THRESHOLD  IS  ON  THE  a  POSTERIORI  PROBABILITY  PIC./X) 
WHERE  X  IS  THE  TEST  VECTOR  ' 


Figure  B-15.  Flow  chart  ot  procedure  classify  of  Gaussian  classifier 
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Figure  B-16.  Feature  ranking  using  the  mahalanobis  distance  criterion. 
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